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The  rapkl  actvancesof  cockpit  automation  the  last  dac^e  outstripped  the  ability  of 
the  human  factors  profession  to  understand  the  <^ange$  in  human  functions  required. 
Highiechnoiogy  cockpits  reqtare  less  physical  (observable)  workload,  but  are  highly 
demanding  of  cogr^ttve  functions  such  as  planning,  alternative  selection,  and 
monitoring.  Furthermore,  automation  creates  opportunity  for  new  and  more  serious 
forms  of  human  error,  and  many  pilots  ase  concerned  about  the  possibility  of 
complacency  affecting  their  performance. 

On  the  pcisitive  side,  the  equipment  works  "as  advertisecf  with  high  reliability,  offering 
Ivghiy  efficient,  computer-based  fKghi  These  findings  from  cockpit  studies  probably 
spply  equally  to  (4her  industries,  such  as  nuclear  power  production,  oUier  modes  of 
transportation,  mecfidne.  mititary  systems,  and  manufacturing,  all  of  which 
traditionally  have  looked  to  a\nation  for  tectimotogicai  leadership.  The  challenge  to 
the  human  factors  profession  is  to  aid  designers,  operators,  and  training  departments 
in  exploiting  the  positive  side  of  automation,  while  seeking  solutions  to  the  negative 
side. 
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Mieat&t  Rotation  SidUs  ^ 

Diane  L.  Damos,  PhD. 
University  of  Southern  California 


Abstract 

Foio*  experinients  concemed  with  mental  rotation  Neills  are  desoibed.  The 
purpose  of  these  studies  was  to  determine  the  effect  of  extended  practice  on 
rotational  skills,  establish  their  generality,  and  determine  if  th^  can  become 
automated  with  practice.  B;ttcaided  practice  resulted  in  extremely  hig^  rotation  rates. 
M<mtai  rotation  skills  tratuif^ed  b^een  stimuli  with  the  higjb^  transfer  between 
stimuli,  that  were  most  ;iimilar.  The  possibility  of  automatization  ctmld  not  be 
established 

Recently,  the  concept  of  'situatianal  awareness"  has  generated  much  interest  in  both  the 
operational  a^  research  communities.  To  date,  most  of  the  attempts  to  increase  situational 
awarwess  have  been  concerns!  with  changing  the  amount  of  information  di^layed  to  the  piktt, 
the  format  of  die  mformation,  and  in  some  cases  the  nature  of  the  di^Iay^  infonnation. 

A  second  approach  to  increasing  situational  awareness  is  throu^  training.  This  approach 
has  generated  little  interest  to  date,  perhaps  because  of  the  con^ilex,  multibceted  nature  of  the 
concept  Attempting  to  train  situational  awareness  as  a  unitary  skill  may,  therefore,  be  htdle. 
Training  sped&c  skids  that  contribute  to  situadona!  awareness,  on  the  other  hand,  may  be  an 
elective  method  for  Increasing  the  pikt  s  general  level  of  situational  awareness. 

Spatial  information  processing  skills  are  frequentfy  assumed  to  contnbute  substantially  to 
situational  awareness.  A^ough  the  specific  skills  that  contribute  to  situational  awareness  have 
not  been  identified,  mental  rotation  appears  to  be  involved  in  a  number  of  flying  tasks.  For 
example,  a  pilot  approaching  an  aiipon  from  other  than  a  southerly  direoion  may  have  to 
rotate  the  airport  dtagram  mentally  to  coincide  vwth  the  direction  of  approach. 

Mental  rotation  skills  were  selected  for  «(armnation  primarily  because  they  appear  to 
contribute  to  situational  awareness.  AdditionaUy,  mental  rotation  has  been  extensively  studied 
in  laboratory  environments.  Consequently,  a  large  data  base  exists  that  could  be  used  in 
designing  experiments  and  ir;terp:'eting  results. 

Four  experiroents  are  discussed  briefly  in  this  paper.  These  experiments  were  designed 
to  provide  a  foundation  for  a  training  package  that  would  increase  a  pilot’s  situational 
awareness  by  improving  the  pilot’s  mental  rotation  skills.  The  first  purpose  of  these 
experiments  was  to  determine  the  effect  of  extended  practice  on  rotational  skills.  The  second 
purpose  was  to  determine  the  generality’  of  these  skills;  if  situational  awareness  is  to  be 
improved,  rotational  skills  must  transfer  from  a  training  situation  to  an  operational  setting.  The 
third  purpose  was  to  determine  if  rotational  skills  could  become  automated  with  practice. 


‘  This  research  was  conducted  under  Conuact  No.  N00014-86-K-0119.  Dr.  Tom  Jones  was 
the  contract  monitor. 


General  Method 


Apparatus 

A  DEC  Micro  PDF  1 1  computer  generated  all  stimuli,  recorded  and  processed  subject 
responses,  and  timed  all  trials.  The  stimuli  were  displayed  on  a  Tektronix  4125  CRl’.  Subject 
re^nses  were  made  using  4X4  matrix-type  keypads  attached  to  the  subject’s  diair. 

Right-handed  males  between  the  ages  of  18  and  35  were  recruited  for  the  experiment. 
All  subjects  were  native  English  speakers  and  had  no  flight  training.  Subjects  were  paid  a  flat 
fee  for  completing  the  experiment  and  could  receive  bonuses  for  good  performance. 

The  subject’s  task  was  to  distinguish  as  quiddy  as  possible  between  a  stimulus  and  its 
mirror  image.  Except  in  the  training  phase  of  Experiment  3,  stimuli  were  presented  at  the 
upright  (0  degree)  position  and  at  the  60.  120,  180,  240,  and  300  degree  positions.  In  the 
training  phase  of  Experiment  3,  stimuli  were  presented  at  increments  of  36  degrees.  Hte 
subject  used  the  indn  finger  of  his  dominant  to  make  a  "standard*  response  and  the  index 
finger  of  his  nondominanl  hand  to  make  a  "mirror"  reqmnse. 

Three  stimuli  were  used  in  these  experiments;  F,  G,  and  a  24-point  abstract  shape 
(stimulus  #29,  Va.iderplas  and  Garvin,  1959).  A  trial  consisted  of  30  representations  of  a 
stimulus  and  30  presentations  of  its  mirror  image.  The  letter  and  its  mirror  image  were 
presented  five  times  at  each  orientation.  At  the  end  of  each  trial,  the  subject  was  shown  his 
percentage  of  correct  resftonses  and  his  correct  RT. 

A  second  usk,  the  matrix  task,  was  used  in  Experiment  4.  In  this  task  5X5  matrix  grids 
were  presented  sequentially  to  the  subject.  Each  matrix  had  five,  randomly-selected  illuminated 
cells.  The  subjea’s  task  was  to  determine  as  quickly  as  possible  if  the  current  matrix  was 
identical  to  the  preceding  matrix.  If  the  current  matrix  was  identical  to  the  preceding  matrix, 
it  was  not  presented  in  the  same  orientation;  the  second  of  two  identical  matrices  was  always 
rotated  90  degrees  relative  to  first  matrix.  If  the  current  matrix  was  a  rotated  version  of  the 
immediately  preceding  matrix,  the  subject  responded  soine.  Otherwise,  he  responded  iUfferent 
Approximately  50%  of  the  correct  responses  on  any  given  trial  were  same  and  50%  different. 

Procedure 

Subjects  in  the  experimental  groups  Ln  Experiments  1,  2,  and  3  completed  one  testing 
session  per  day  on  each  of  ten  working  days.  These  subjects  performed  the  mental  rotation 
task  with  one  stimulus  during  the  first  week  and  with  the  second  stimulus  during  the  second 
week  of  testing.  Subjects  in  the  control  groupis  of  these  thr  te  studies  received  only  five 
experimental  sessions.  Each  subject  in  the  first  three  experimenls  made  10800  responses  each 
week  of  the  experiinenl. 

Subjects  in  Experiment  4  received  differing  amounts  of  practice.  The  procedure  for  this 
fcjq)eriment  is  descril>cd  in  the  appropriate  section  below. 
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Experiment  1 


Irtroductiofi 


The  purpose  of  this  experiment  was  to  exairslne  the  effect  of  attended  practice  on  the 
mental  rotation  task  and  to  begin  examining  the  generality  of  the  required  skills.  Two  letters, 
F  and  G,  were  chosen  us  stimuli.  Because  both  of  these  letters  were  familiar  to  the  subjects 
and  both  were  the  same  type  of  stimuli  (letters),  this  experiment  was  expected  to  produce  the 
greatest  number  of  statistical  tests  demonstrating  positive  transfer. 

Tv/enty  subjects  were  di.ided  into  two  groups.  One  group  trained  with  the  letter  F  and 
transferred  to  the  letter  G.  The  second  group  trained  with  G  and  transferred  to  F.  .Although 
there  was  no  true  control  group  in  tnis  experiment,  the  tra.nsfer  performance  of  one  group 
could  be  compared  to  the  training  performance  of  the  other  group. 

Results 

Preliminary  analyses.  To  understand  tiic  results,  the  analysis  procedure  must  be 
understood.  Correct  responses  in  the  mental  rctai-icn  paradigm  are  related  to  the  position  of 
the  stimulus  in  the  following  way; 

RT  =  alpha  +  beta  (D)  (1) 

where: 

RT  is  the  correct  reaction  time 
alpha  is  the  intercept  of  the  equation 
beta  is  the  slope  of  the  equation 

D  is  the  absolute  degrees  of  rotation  of  the  stimulus  from  vertical 

Thus,  mental  rotation  data  can  be  described  by  two  parameters,  alpiia  and  beta.  These  two 
parameters  are  associated  with  specific  cognitive  processes  (see  ^rg.  Hertzog,  and  Hunt,  1982 
for  a  brief  discussion).  The  slope,  beta,  reflects  the  speed  of  the  mental  rotation  of  the 
stimulus.  The  intercept  reflects  the  encoding  of  tue  stimulus,  comparison  of  the  encoded 
stimulus  with  an  image  held  in  memory',  and  response  selection  and  execution.  Thus,  because 
data  from  the  ment^  rotation  paradigm  can  be  represented  by  Equation  1,  the  effects  of 
extended  practice  and  timesharing  on  rotational  skills  can  be  determined  separately  from  their 
effects  on  the  encoding,  comparison,  and  response  selection  stages.  Similarly,  transfer  of 
rotational  skills  can  be  examined  separately  from  the  transfer  of  the  other  cognitive  processes. 

For  the  first  three  experiments,  each  testing  session  was  divided  into  two  parts.  The  raw 
data  within  each  block  were  pooled  to  create  an  average  correct  reaction  time  (RT)  for  the 
standard  and  mirror  versions  of  the  stimulus  at  each  absolute  degrees  of  rotation  for  each 
subject  Equation  I  was  then  fit  to  the  data  from  each  part.  Several  analyses,  which  are 
described  below,  were  conduaed  on  these  data. 

For  a  variety  of  reasons,  estimatc-s  c:  transfer  could  not  be  obtained  using  traditional 
techniques.  Instead,  the  method  of  calcuiaiing  transfer  of  training  using  curve  fitting  described 
by  Spears  (1985)  was  adopted.  The  data  from  the  first  three  experiments  were  fit  by  an 
exponential  equation  of  the  form; 

dv=  c  exp  (gx)  +  h 


(2) 


c,  g,  and  h  are  the  parameisirs  lo  be  £i 
X  is  the  block  tmmber 

dv  is  the  dependent  variable  (alpha  or  beta). 


Each  of  these  three  parameters  represents  different  aspects  of  human  performance.  The 
rate  of  improvement  in  performance  is  represented  by  the  second  parameter,  g.  Asymptotic 
performance,  the  performance  level  after  an  infinite  number  of  trials,  is  estimate  by  the  third 
parameter,  L  The  sum  of  the  first  and  third  parameters  (c  +  h)  represents  the  point  at  which 
the  function  crt-sses  the  y-axis.  In  human  performance  terms,  the  quantity  (c  +  h)  represents 
the  level  of  pe:';armance  before  any  practice  occurs  on  the  task  (Spears,  1985)  and  is  known 
as  the  beginniiig  level  Thus,  this  technique  provides  a  mere  detailed  analysis  of  transfer  of 
training  than  the  traditional  formulas,  which  result  in  only  one  global  estimate  of  transfer. 

Estimates  of  transfer.  The  results  of  all  of  the  transfer  analyses  are  too  numerous  to 
recite.  Briefly,  analyses  conducted  on  beta,  the  rate  of  rotation,  showed  positive  transfer  for 
both  ^oups  on  c,  for  one  ^oup  on  g,  and  for  the  other  group  on  h.  Thus,  prior  practice 
affect^  the  beginning  level  of  the  rate  of  rotation,  the  rate  of  learning,  and  its  asymptotic  level 
To  provide  the  reader  with  some  idea  of  the  levels  of  performance  achieved,  the  estimated 
asymptotic  rate  of  rotation  for  one  group  was  .37  ms/degree,  which  is  equivalent  to  2700 
degrees/s. 

Analyse.s  conducted  on  alpha  again  showed  transfer  benefits  for  the  c,  g,  and  h  parameters. 
Thus,  prior  practice  benefited  the  initial  duration,  rate  of  improvement,  and  asymptotic  level 
of  the  durations  of  the  encoding,  comparison,  and  response  selection  stages  of  processing. 
Again,  differences  in  the  asymptotic  level  were  unexpected. 

Effect  of  extended  practice.  Because  the  average  rate  of  rotation  was  so  great,  the  subjects 
may  effectively  have  ceased  to  rotate  the  image  mentally  before  making  a  re^nss.  To  test  the 
idea,  two  three-way  analyses  of  variance  (ANOVAs)  (Group  X  Stimulus  Type  X  Rotation) 
were  conducted  on  the  correct  RTs  of  the  last  block  of  trials  of  each  week.  Neither  ANOVA 
showed  a  significant  effect  of  rotation. 

Bigeussiao 

To  interpret  the  results,  it  is  easiest  to  begin  with  the  transfer  data.  The  significant  between- 
group  differciices  on  c  for  both  alpha  and  beta  were  not  surprising;  initial  performance  on  a 
transfer  task  typically  benefits  from  prior  practice.  The  transfer  effect  on  g  for  alpha  and  beta 
also  was  expected.  The  effect  on  h  for  both  alpha  and  beta,  however,  was  surprising;  5  hours 
of  practice  was  not  considered  sufficient  to  produce  differences  in  the  estimates  of  asymptotic 
performance  between  the  "experimenial*  and  the  'ccntrol"  groups.  These  results  cannot  be 
eqilained  at  present 

The  positive  ftansfer  for  aiphr.  may  have  fewer  practical  implications  than  apparent.  As 
noted  earlier,  alpha  represents  ifiree  stages  of  proces.sir.g.  Theoretically,  positive  transfer  could 
result  from  changes  in  the  duration  of  any  combination  of  the  three.  In  this  experiment,  the 
most  logical  source  of  this  change  is  the  response  selection  stage.  Before  the  subjects  began 
the  transfer  phase  of  the  experunent,  they  made  almost  llOOU  responses  with  the  keypad. 
Consequently,  the  duration  of  the  response  selcctior.  stage  should  riave  been  mmimized  by  the 
end  of  the  training  phase.  Because  ^he  l-f*vr>Bd  wsis  used  in  both  n.hases  of  the 


expefimen-t.  the  duration  of  the  response  seiectian  stage  may  have  been  niinimal  at  the 
beginning  of  the  transfer  phase,  resulting  in  the  positive  transfer  for  the  estimated  initial  level 
of  performance.  The  low  initial  value  of  c  may  also  have  caused  the  appaient  difference  in  g, 
tile  rate  of  improvement  pairameter. 

The  data  indicate  that  with  extended  praaice,  the  correct  RT  was  no  longer  related  to 
the  angle  of  rotation.  Mathematically,  this  result  implies  an  infinitely  high  rate  of  rotation. 
From  a  more  practical  perspective,  this  finding  might  indicate  that  performance  became 
automated  with  practice.  No  operational  definition  of  automaticity  exists  for  a  mental  rotation 
task.  Consequently,  these  results  are  suggestive  of  automaticity  but  not  deCLcitive. 

Experiment  2 


Introduction 

Although  the  results  of  the  first  experiment  were  encouraging,  the  use  of  a  strictly  within- 
subject  design  limits  the  conclusions  tliat  can  be  drawn  from  the  data;  asymmetric  transfer  can 
occur  in  such  designs,  influencing  the  data  in  impredictabie  ways.  The  second  experimeni 
attempts  to  replicate  the  results  of  Experiment  1  by  using  a  traditional  transfer  of  training 
design.  Such  designs  are  not  susceptible  to  asy.mmetric  transfer.  The  second  experiment 
provides  more  insight  into  the  generality  of  mental  rotation  skills  by  examining  transfer  from 
letters  to  an  abstract  shape. 

Thirty  subjects  were  divided  into  three  equal  groups.  One  group  was  an  experimental 
group  that  trained  with  the  letter  G.  .Another  was  an  experimental  group  that  trained  with  the 
letter  F.  Tlie  third  group,  a  control  group,  participated  only  in  the  transfer  phase  of  the 
experunent,  W’hich  used  the  abstract  shape. 

figsuiis 

Estimates  of  transfer.  Analyses  performed  on  response  curves  for  beta  showed  no 
significant  between-group  differences.  Analyses  performed  on  alpha  showed  between-group 
differences  favoring  the  experimental  groups  on  c  and  h,  the  initial  level  and  the  estimated 
asymptote. 

Effect  of  extended  practice.  The  same  analysis  used  b  Experiment  1  was  conducted  on 
the  transfer  data  from  this  experiment.  These  data  showed  an  effect  of  rotation,  bdicatbg 
that  even  witii  extended  practice,  correct  RT  was  related  to  the  angle  of  rotation. 

Discussion 

The  results  of  this  experiment  were  considerably  less  encouragbg  than  those  of 
Experiment  1;  prior  practice  with  a  letter  had  no  effect  on  the  rotation  rate  for  an  abstract 
siiape  although  the  initial  level  and  the  asymptotic  level  of  alpha  still  benefitted.  Agam,  the 
positive  transfer  for  alpha  probably  reflects  famLibrity  with  the  keypad  and  is  of  little  practical 
significance.  Additionally,  extended  practice  did  not  alter  ihe  relation  between  correct  RT  and 
the  angle  of  rotaiion  as  exyrressed  b  Experbient  1.  Thus,  the  tentative  evidence  for 
automaticity  four,'!  hi  Ex’perimsni  I  was  not  replicated  in  Experbient  2 


Experiment  3 


Tutroduction 

Although  less  transfer  was  found  in  Experiment  2  than  in  Exp)eriment  1,  in  both 
ex}<eriments  the  trahiing  and  the  transfer  stimuli  were  presented  in  increments  cf  60  degrees. 
Thus,  the  observed  transfer  may  have  been  caused  by  familiarity  with  the  position  of  the  stimuli 
rather  than  by  transfer  of  rotational  skills.  Experiment  3  used  different  degrees  of  rotation  in 
the  training  and  the  transfer  phases  to  eliminate  any  spurious  effects  caused  by  familiarity  with 
the  position  of  the  stimuli. 

Twenty  subjects  were  divided  into  two  groups  of  ten  subjects.  One  group  was  an 
experimental  group  that  trained  with  the  letter  G.  The  second  group,  a  control  group, 
participated  only  in  the  transfer  phase  of  the  experiment,  which  used  the  abstract  shape. 

Essulps 

Estimates  of  transfer.  The  experimental  and  control  groups  differed  significantly  on  c 
and  h  for  beta,  Both  analyses  demonstrated  better  performance  for  the  experimental  group 
than  for  the  control.  The  groups  did  not  differ  on  alpha. 

Effect  of  extended  practice.  As  in  Experiment  2,  an  analysis  conducted  on  the  transfer 
data  showed  that  extended  practice  did  not  affect  the  relation  between  correct  RT  and  the 
angle  of  rotation. 

Discussion 

Experiment  3  provided  evidence  for  the  transfer  of  rotational  skills  that  cannot  be 
attributed  to  the  sp>eafic  degrees  of  rotr.tion  used  for  the  training  and  transfer  stimuli.  More 
importantly,  transfer  was  found  for  beta,  which  reflects  the  rate  of  rotation,  rather  than  for 
alpha,  which  reflects  the  encoding,  comparison,  and  response  selection  stages.  Although  the 
rate  of  improvement  in  the  sp>eed  of  rotation  (g)  was  not  affected  by  prior  practice,  both  the 
initial  levd  of  performance  and  the  asymptotic  level  benefitted  from  prior  practice. 

Experiment  4 


introduaion 

This  experiment  examined  dual-task  mental  rotation  performance  as  a  function  of  practice 
and  had  two  prlmarj'  purposes.  Tne  fiist  purpose  was  is  to  determine  if  p5erf0nnar.ce  on  the 
mental  rotation  task  can  become  automated  with  i^ractice.  The  results  of  Exp>eriment  1 
provided  some  indication  that  pe.'dormance  may  have  been  automated.  Experiment  4  addresses 
the  question  of  automaticity  direaly  by  having  subjeas  perlbrm  a  second  task  concurrently  with 
a  well  practiced  mental  rotation  task.  If  performance  or.  the  mental  rotation  task  is  unaffected 
by  the  prese.nce  of  another  task,  then  the  mental  rotation  task  can  become  automated. 

Die  second  purpose  of  the  experiment  was  10  determine  if  dual-task  p}enormance  is 
affected  by  the  amount  of  prior  single-task  practice.  Because  many  types  of  timesharing  skills 
may  be  involved  in  duai-i.isk  performance,  singie-iask  practice  beyond  some  minimal  amount 
may  have  little  effect  on  dual-task  p5erformarice.  Three  levels  of  single-task  performance  were 


vii^uded  in  Ejqperiment  4  to  determine  if  increasmg  the  amount  of  singje-tai»k  practice  beyond 
tKucrie  minimal  amount  affected  dual-task  performance.  The  three  levels  required  10800,  6480, 
and  900  re^onses  before  the  dual-task  phase  of  the  experiment.  One  group  of  ten  subjects 
experience  each  of  the  levels  of  single-task  practice. 

BssiiM 

The  results  of  this  experiment  are  very  compile  and  will  be  discussed  cmly  briefly.  To 
understand  the  results  of  the  dual-task  analyses,  the  single-task  performance  levels  of  the  three 
gproups  on  the  mental  rotation  task  must  be  desaibed  The  group  with  the  most  extensive 
practice  had  the  fastest  correct  RTs  but  the  highest  error  rate.  The  group  with  the  least 
practice  had  the  longest  average  correct  RT  and  an  intermediate  error  rate.  The  three  groups 
received  the  same  amount  of  praaice  on  the  matrix  task  and  did  not  differ  on  either  correct 
RT  or  error  rate.  The  dual-task  analyses  revealed  no  dear  advantage  for  the  group  having  the 
most  extensive  single-task  practice  and  did  not  reflect  the  single-task  rank  ordering  of  the 
groups. 

An  ANOVA  was  conducted  on  rotation  task  data  for  the  group  that  received  the  most 
extensive  single-task  practice.  The  ten  trials  preceding  dual-task  practice  were  analyzed  The 
analysis  revealed  that  correct  RT  was  related  to  the  angle  of  rotation. 

Discugsiac 

The  results  indicate  dearly  that  increasing  the  amount  of  single-task  practice  beyond  some 
minimum  does  not  improve  dual-task  performance;  the  betiveen-group  differences  did  not 
unifonnly  favor  the  gro’.sp  that  received  the  most  sin^e-task  practice.  The  dau  were,  however, 
considerably  less  dear  concerning  automatkity;  the  single-task  data  indicated  that  correct  RT 
was  affected  by  the  angle  of  rotation.  Thus,  these  data  did  not  reach  one  plausible  criterion  for 
putoxnatidty.  The  most  common  dual-task  criterion-lack  of  a  decrement-also  vsras  not  met. 
Thus,  performance  on  the  mental  rotation  task  does  not  appear  to  become  automatic  with 
practice. 


General  Discussion 

As  noted  in  the  Introduction,  these  experiments  were  designed  to  provide  a  foundation 
for  a  training  package  to  increase  situational  awareness.  On  the  whole,  the  results  of  the  first 
three  experiments  were  encouraging.  Mental  rotation  skills  improve  dramatically  during  the 
first  5  hours  of  practice.  These  skills  also  appear  to  transfer  between  stimuli  and  between 
^>ecific  presentation  positions.  Some  of  the  transfer  may  be  caused  ty  familiarity  with  the 
response  devices,  but  some  of  it  appears  to  be  the  result  of  improved  skills  in  two-dimensional 
rotation. 

Interpreting  the  results  of  the  fourth  experiment  proved  problematic  in  part  because  no 
generally  accepted  operational  definition  of  autcmaticity  for  a  mental  rotation  task  exists. 
Extended  single-task  practice  had  no  obviously  beneficial  effect  on  dual-task  perfoimance,  and 
providing  more  than  a  minimal  amount  of  single-task  practice  may  not  be  cost  effective. 

More  applied  research  must  be  done  on  mental  rotation  skills.  Clearly,  additional  work 
on  three-dimensional  rotation  is  needed.  At  some  point,  rotation  should  be  studied  in 
v,’ith  move.ment  of  the  object.  The  results  of  these  studies  indicate  that  training 
mental  rotation  skills  may  be  a  cost-effective  method  for  Lmproving  situational  awareness. 
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t  J <aa;y  G.  Forrest,  Ed-D.,  Ph.D. 

3208  N.  Academy  Blvd,  Suit©  160 
Colorado  Springs,  CO  80S17 

of  this  presentatioR  will  includfi;  (1 )  a  brief  review  of  the  historic 
us^abuses  of  ^icoh^  in  cyfferent  societies,  (2)  epidemiology  and  paherns  of  a{a)hol 
jj^^use  in  modem  Ameritan  society,  and  (3)  an  examination  of  the  various 
pstfameters  of  responsible  drinking/aicohol  use  in  modem  American  society. 
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ORGANIZATIONAL  FACTOF^  IMPACTING 
imA  PERFORMANCE 

Robert  C.  Ginnett,  Ph.D. 

Department  of  Behavioral  Sciences 
and  Leadership 

USAF  Academy.  CO  80840-5701 

In  1383.  Richard  Hadcman  (now  at  Harvard  Univar^}  and  1  embarked  upon  a  long 
tOriniiASA  funded  research  program.  The  purpose  was  to  understand  and  improve 
te^.  perfonnafice  in  aeronautical  and  space  environments.  That  purpose  has 
temained  unchanged  but  the  funding  and  focus  have  altered  as  we  have  learned 
more  about  tiie  phenomenon  and  also  as  we  grappled  with  the  areas  we  did  not 
Ifflow  enough  about.  For  the  current  phase  of  the  research,  total  funding  comes  fmm 
the  'space*  i^e  of  NASA  and  is  tied  directly  to  cur  realization  that  long  duration 
space  flight  require  a  better  understancfing  of  groups  at  work.  Afteraii.  three  years 
tc^ether  in  a  confined  capsute  on  a  Mars  mission  will  necessitate  some  group 
process  skills  if  the  team  Is  to  av(»d  self-destruction. 

Our  focus  has  evolved  more  as  a  function  of  our  learnings  in  earMer  phases.  In  the 
fiiet  phase,  i  examined  in  detail  the  formation  process  of  commercial  airline  flight 
crevtrs  and,  at  a  coarser  level,  their  on-line  oew  performance.  A  most  important 
finding  was  the  power  of  the  leader  in  formir^  an  effective  crew  from  the  first  moments 
of  the  crew's  Ste.  This  study  also  resulted  In  a  few  refinements  of  Hackman's 
normative  model  of  team  perfoimance.  particularty  in  the  area  of  authority  dynamics 
associated  with  effective  vs.  less  effective  captains. 

We  also  realized  that  teams  forming  and  operating  in  organizational  settings  were 
very  different  from  teams  of  studems  or  groups  of  psychiatric  pationts  in  therapy.  In 
fact,  the  organization  and  its  environment  played  a  critical  role  in  estsd^Oshing  the 
conditions  for  leadership  and  team  effectiveness.  We  have  labeled  these  corKtitions 
”organizabonai  shells.”  But  to  understand  which  organizational  factors  are  most 
a|;^propriate  for  enhandng  team  effectiveness  would  require  a  large  scale  research 
effort-one  that  looked  at  teams  performing  the  same  type  of  work  but  across 
organizations  (as  opposed  to  within  the  same  organization),  it  also  vrould  require 
teams  of  researchers. 

After  0  brief  review  of  the  background,  the  presentation  wi!!  describe  the  methodology 
of  Phase  Two  of  the  research,  a  general  description  of  the  types  of  organizations 
examined,  and  a  brief  discussion  of  the  data  collection  proc^ures  and  the  teams  that 


the  data,  including  the  range  of  problems  encountered.  Finally,  a 
presentation  of  the  prelroinaiy  results  of  the  organizational  factors  based  upon  the 
perceptions  of  observed  crews  will  be  presented.  Opportunity  for  discussion  and 
questions  will  be  provided. 


■  ^  ^  Richard  Koubek,  Ph.D. 

Cofl]^  of  Eh^jnsering  &  Computer  Science 
Dayton.  OH  45435 

the  early  part  of  the  20th  cemuiy.  the  industrial  revolution  brought  about 
in  the  vvodqptace  by  impteoienting  automation  technology  for 
pt^sM  task  cornponanis  of  a  worker's  job.  Society  is  presently  in  the  throes  of 
andthar  favoiutlon  with  the  advent  of  the  information  age,  where  <x>gnitive  task 

■  ttotopopej^  are  now  beings  automated  with  sik^  tedmologies  as  expert  systems  and 
hffijr^  hets.  Viniite  many  paiMels  between  the  two  periods  erdst,  the  information  ^e 
is  unique  in  that  task  components  being  modified  are  no  longer  visible  anil  must  be 
Jtofeaed. 

to  the  complexity  ot  intereshng  cognitive  ta^,  and  current  technological 
Wte^HS.  *biute  torc£”  approaches  have  only  been  ma^nally  adequate.  Rather, 
re^toi^ed  mentoers  of  toe  field  have  suggested  that  in  order  to  obtain  performance  at 
the  human  expert  leyel,  systems  must  necessarily  incorporate  not  only  toe  content. 
t>(4  also  the  manner,  in  which  human  experts  peilonr.  the  cognitive  task.  Therefore, 
understaridtng  h^hiy  ^lled  cognitive  p^rmance  is  a  criticai  element  in  the  effort  to 
automate  cognitive  tosks.  The  present  fiterature  suggests  at  least  three  components 
oontitoute  to  cognitive  task  pertormance:  automation,  problem  representation  and 
cognitive  a^ies  (rndivictoal  differences).  Koubek  and  Saivendy  (1988)  performed  a 
series  of  studies  examining  these  aitoroaches  and  have  found  knowledge 
representation  to  be  the  primary  determinant  in  high  ievel  cognitive  performance. 

in  this  presentafion,  toe  industrial  and  information  revolutions  will  be  contrasted  to 
identify  paraKels  and  potential  points  for  leveraging  automation  into  cognitive  tasks. 
SecarKi.  it  will  prowde  an  overview  of  approaches  to  skilled  cognitive  task 
performance  ^  irtoicate  how  they  can  serve  as  a  basis  for  expert  systems 
development.  Fmaity,  research  wiil  be  presented  which  attempts  to  determine  how 
the  approaches  can  be  combined  to  serve  as  a  basis  tor  developing  automation 
tochnoiogy  for  cognitive-oriented  tasks. 
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w  :  /  AT  WORK  AND  HOME 

Thomas  RO’Heam.Ph-D. 

Front  Range  institute 
425  West  Rockrimmon  Blvd. 

Colorado  Springs,  Colorado  80919 

€^n,  tenest  sharing  of  thoi^hts  and  feelings  can  be  one  way  of  defining  "intimacy", 
in^ansaetional  analysis  therry,  there  are  six  ways  of  spending  time.  They  are: 
witix^mwai;  rituals;  pai^mes:  activities:  games;  and  intinxu^y.  In  order  to  achieve 
Intima^  the  essential  ingredients  are  two  or  more  individuals  who  are  seeing 


themselves  and  the  others  vrith  whom  they  are  interacting  as  being  "OK".  When  a 
■flotOlC.po^ion  enters  into  the  transaction  then  intimacy  is  not  avaiablo. 

Getting  on  the  "game"  or  "drarr^"  triangle  can  make  for  nonproductive  work  as  well  as 
personai  relationships.  Learning  ways  to  stay  out  of  "gaming"  transactions  can 
increase  productivity  by  creating  an  atmosphere  where  individuals  are  free  to  share 
their  ideas  and  feeHngs.  A  theoretical  model  will  be  presented  whk^  will  look  at  how 
philosophical  life  posttion.<^  can  enhance  or  interfere  with  transactions. 
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€;wiSiaNS  BY  METAPHOR:  A  NOVEL  APPROACH  TO  LEADERSHIP 

Bmis  Richardson,  D.BA 
I^an  of  thd  Schooi  of  Business.  Cenlenaiy  College 
Shreveport.  Louisiana  711 C4 

medlioae  organizations  be  transformed  into  extra-ordinary  organizations? 

U  iwn  to  be  extraordinary?  Ajb  there  principles,  concepts,  or  guidelines 
be  used  to  get  extraordinary  performance  from  ordinary  people?  What  does  it 
to  do  common  tiangs  uncommonly  well? 

4$^sc^  of  outstaridingo^  in  any  field  of  human  endeavor  seem  to  have 

common.  For  one  thing,  they  do  not  use  complicated,  abstruse,  or 
tll^te^r^ta^ruques.  Rather,  they  use  ^pie,  practicai  concepts.  These  deceptively 
'  srmi^fde^  Bke  die  ideas  contained  in  die  Sermon  on  the  Mount  or  the  Bhagavad- 
are  ea^  to  oomf^afiend,  but  not  ^ivays  easy  to  put  into  action. 

An  idea  can  be  simpie  and  yet  not  be  simplistic.  The  Jaguar  has  simple  yet  elegant 
tines;  Einstein's  theory  of  general  relativity  is  summarized  in  a  simple  statement.  Adam 
Smith's  metaphor  of  people  following  their  own  self-interest  as  if  they  were  being  led  by 
an  invisible  hand  to  serve  the  common  good  is  both  a  simple  and  brilliant  insight  that 
captures  the  essence  of  how  die  free  market  works. 

Simple  yet  eiegant  management  ideas  are  presented  as  metaphors.  By  metaphors,  I 
moan  a  variety  of  anecdotes,  parabtes,  ar^dogies,  simiiies;  in  short,  the  kind  of  text  that 
conjures  mental  (xclures  that  can  be  easily  stored,  retrieved,  and  communicated.  This 
is,  ot  course,  an  ancient  approach  to  passing  on  information,  but  one  worth  harking 
b3d(  to.  For  in  trying  to  b^me  modem,  objective  managers,  we  often  squeeze  out  the 
juice,  the  poetry,  the  rhetoric,  the  feelings,  and  the  emotions  tha;  are.  to  a  great  degree, 
what  human  activity  is  all  about. 

This  presentation  will  present  five  examples  of  powerful  metaphors  which  can  help 
galvanize  a  team  and  energize  individuals  to  perform  at  an  exceptional  level.  The 
metaphors  are: 

1)  The  10%  Principle,  4)  Easter  Island  Mystery 

2)  Metaphor  of  the  Redwoods  5)  The  Beaver  Paradox 

3)  The  Chinese  Eye* 


This  is  an  unusual  approach  to  management,  but  there  is  evidence  that  both  college 
stL«dents  and  managers  from  all  Industries  find  the  approach  memorable  and  useful. 
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I^STOBiCALSTUDiHS  IN  LEADERSHIP 

Larry  Silverman 
Univsrsify  of  Colorailo 
Boukior,  Coiomdo 
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acoopt  th©  principle  that  leadership  cani  be  taught  in  the  classroom,  then  we  must 
Mk  elsewhere  tor  ways  to  guide  the  development  of  leaders.  Historical  accounts 
0rit2fln  many  incfividu^s  whose  character,  development  and  acts  teach  us  important 
lessons  a^ut  leadership.  By  starting  with  Plutarch's  biography  of  Alexander  the  Great 
aod  progressir^  through  leaders  such  as  Caesar,  Chartem^ne  and  Joan  of  Arc, 
certain  l^oad  patterns  become  salient.  Studying  figures  from  recent  history  such  as 
AtaturK,  Churchill  and  de  Gaulle  reveals  how  these  patterns  have  coruinued  to  develop. 
-My  approach  aims  to  sensHtze  students  to  the  qualities  and  behaviors  of  acknowledged 
leaders  trom  the  past  so  tf^  might  better  be  able  to  recognize  these  qualities  in 
themselves  their  contemporaries. 


LEADERSHIP  EDUCATION  FOR  UNDERGRADUATES 

RlCH/tfiD  L  HUGHES,  Ph.D. 

OepartiTjent  Head 

Sehavlorai  Sciences  and  Leadership 
USAF  Academy 


Many  successtui  civilian  and  nrulitary  leaders  believe  leadership  is  not  something  one 
cart  {©am  in  a  t^assroont  it  develops  through  actual  experience,  so  the  argument 
1^65,  mt  (mm  bookwork.  True  view  draws  too  black  and  white  a  distinc^on  between 
experience  and  study,  but  those  of  us  in  academia  are  guilty  of  a  different  error  - 
sometimes  claiming  more  transferability  of  intellectual  lessons  to  “re^  life"  than  may 
be  jusdfied.  in  any  case,  both  groups  have  been  asking  the  wrong  question.  Rather 
than  "How  much  impact  do  academic  courses  have  on  a  studenfs  subsequent 
leadership?*  we  need  to  ask  "How  do  academic  courses  impact  a  student's 
subsequeru  leadership  development?*  We  need  to  think  more  about  how 
coursework  can  contribute  to  a  life-long  continuing  process  of  discerning  critical 
lessons  about  leadetsLip  l>om  experience.  That  orientation  affirms  the  value  of  actual 
experience  in  leadership  development,  but  it  aiso  affirms  tht>  value  of  conceptual 
sophistication  in  being  able  to  learn  from  experience.  That  orientation  aiso  suggests 
altemattve  pedagogical  approaches  to  the  leadership  cunicuium  that  would  be 
geared  toward  potentiating  the  student's  readiness  to  learn  from  experience. 
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l-EADERS  UNDER  STRESS: 

COGNITIVE  MANAGEMENT  IN  REVOLUTION  AND  WAR 


Peter  Suedfeid,  Ph.D.,  F.R.S.C. 

The  University  of  British  Columbia 
#235-2075  Wesbrook  Mall 

Vancouver,  B.C.  Canada  V6T  1Z3 

Cnfcques  of  high-level  decision  making  in  interrialional  and  national  crises  have 
frequent  fooised  on  the  errors  that  leaders  commit  in  processing  information.  Such 
errors,  usually  In  the  direction  of  oversimplifying  the  cognitive  field  (e.g.,  ignoring 
relevant  information,  discarding  possibly  fruitful  options  too  soon,  not  considering 
how  a  particular  decision  would  be  perceived  by  the  other  side),  lead  to  hasty  and 
inadequate  decisions,  and  outcomes  ranging  from  the  less  than  optimal  to  the 
cisaslrous.  Such  concepts  as  “salisfidng."  “groupthink,"  "symptoms  of  deficient 
decision-making,"  and  the  "cognitive  miser*  model  all  accept  this  paradigm  to  a 
greater  or  lesser  extent 

An  alternative,  the  "cogniUve  manager*  model,  holds  that  intorma^on  processing 
tends  to  be  as  simple  or  as  complex  as  the  circumstances  appear  to  warrant.  Good 
dedsion  makers  are  those  who  accurately  assess  the  appropriate  level  of  complexity, 
neither  skimping  attention  and  cognitive  effort  when  those  are  crucial  nor  expendl.ng 
unnecessary  time  and  energy  on  decisions  that  do  not  require  it  Such  individuals,  in 
any  walk  of  life,  are  good  cognitive  managers  (as  opposed  to  cognitive  misers,  who 
consistently  use  minimum  effort  regardless  of  drcumstances). 

A  reliable  quantitative  measure  of  integrative  complexity  (the  decision  makers 
perception  of  several  dimensions  and  perspectives  on  problems  and  formulation  of 
solutions  that  incorporate  a  number  of  these),  has  been  applied  to  historical 
ctecuments  to  test  the  cognitive  manager  model  among  political,  military  and 
revolutionary  leaders  of  many  countries  through  a  span  of  several  centuries.  Both 
persona!  and  occupational  pressures  tend  to  lead  to  reduced  integrative  complexity: 
in  fact,  such  reductions  consistently  precede  simplifying  solutions  to  major  problems 
(e.g.,  the  dedsion  to  go  to  war).  Successful  dedsion  makers  are  those  who  can 
recogni29  when  there  Is  a  reed  for  moderately  high  levels  of  complexity,  and  to 
adjust  or  maintain  their  complexity  levels  accordingly,  even  under  severe  stress. 
Rather  than  exhorting  or  training  leaders  to  strive  for  maximal  complexity  at  ail  times, 
a  good  strategy  for  leadership  education  should  make  them  aware  of  the  cost-benefit 
tradeoff  between  simple  and  complex  information  processing  in  particular  situations. 


Panel 

Equal  Opportunity  in  the  Department  of  Defense: 
looking  Toward  a  Hew  Century 


LI  Coi  hockey  Dansby.  DEOMI  Director  ot  Research 
Jerry  Scarpate,  Chief  of  DEOMl's  Research  Division 
Dr.  Dan  Landis,  Director  of  the  Center  for  Aj;^piied  Research 
and  Evaiuatian,  University  of  Missisappi 
Dr.  James  Thomas,  consultant  (formerly  of  Army  Research  Institute) 


The  Defense  Equal  Opportunity  Management  Institute  (DEOMl)  is  responsible  for 
training  equal  opportunity  (EO)  advisore  from  all  Services  and  for  conducting 
research  on  EO  issues.  This  panel  session  will  explore  trertds  in  the  military  EO 
arena  DEOMl  representatives  will  present  the  latest  data  on  EO  within  the  DoD, 
highlighting  trends  in  representation  and  utilization  of  women  and  minorities.  Issues 
of  concern  as  we  enter  a  new  century  (e.g.,  ethnic  imbalances  between  officer  and 
enlisted  corps,  ethnic/gendsr  composition  of  the  future  recnjhing  pool,  sexua' 
harassment,  and  combat  exclusion  for  women)  will  be  discussed.  Panelists  will 
discuss  trends  and  policy  changes  that  may  inHuence  EO  in  tbse  future.  ImplicaticfiS  o 
the  changing  demographic  composition  of  the  Armed  Forces  will  be  considared 
Current  research  and  policy  plans  will  be  discussed  as  a  springboard  for  audience 
interaction  with  the  panel  A  number  of  DEOMl  publications  will  be  avi^labie  for  the 
audience. 
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Panal 


“Lean  and  mean,  but  not  too  short,./ 


H.  WaSiace  Sinako,  Panei  Chair 
Dr.  James  Vogei,  U.S.  Army  Institute  of  Environmental  Meciidne 
Dr.  Joe  McDaniel.  AAMRL/HE,  Human  Enginsehng  Division 
Dr.  Arthur  L.  Korotkin,  University  Research  Corporation 
Bethesda,  Maryland 

Dr.  Harold  P.  Van  Cott,  Committee  on  Human  Factors 
National  Research  Ccunci!,  Washington,  D.C. 

Dr.  W.  Steve  Sellman,  OASD,  The  Pentagon.  Washington,  D.C. 

Dr.  Dave  Robertson,  Navy  Personnel  Research  and 
Development  Center,  San  Diego,  California 

The  panel  vwll  address  an  important  and  neglected  area  of  manpower  research  and 
policy,  U..  ptrysic^  standards  tor  military  occupations.  Although  the  U.S.  services 
have  long  hsto  medical  fitness  standards  for  prospedive  entrants,  relatively  little  is 
known  about  how  such  st^dards  are  related  to  the  actual  tasks  required  of  military 
personnel,  or  whethsr  those  sta.hdards  are  valid.  The  domain  is  of  increasing 
importance  because,  in  this  prolonged  period  of  demographic  dedirte  in  the  prime 
recruiting  market,  the  Department  of  Defense  ntay  be  forced  to  make  new  choices  vis- 
a-vis  entry  criteria.  That  is.  in  order  to  r.^aintain  a  quality  force  we  may  have  to  seek 
recruits  who  would  heretofore,  have  been  sneligibla  for  service.  Physical  or  medical 
fitness  poUcies  may  have  to  be  changed  in  order  to  provide  r^eeded  recruits.  Further, 
it  may  become  necessary  to  redesign  equipment  to  accommodate  physical 
characteristics  of  service  entrants.  Change  should  be  based  on  established  fact 
rather  than  historical  precedent  arid  prejudice. 

Panelists  will  deal  with  such  issues  as:  current  physical  selection  standards,  methods 
for  developing  standards  and  guidelines,  the  relationship  of  those  startoards  to  tiie 
performance  of  military  jobs,  human  tacters  design  for  "non-standard'  operators, 
gender  and  ethnic  factors,  corrective  treatment,  and  political  and  societal  factors. 
Participarrts  are  knowledgeable  concerning  military  personnel  specialties  and  related 
OiXupations  in  the  private  sector.  We  sxpe-ct  the  outcomes  of  the  meeting  to  be:  a) 
an  agenda  for  research,  and  b)  actionable  racomrrteridaUons  that  can  be 
implemanted  without  further  research  and  development. 


;  Panel 

Giinicai  Consuitalion  within  Military  Operationai  Units: 

Trends  artd  Prospects 

Edwin  L  Gerwell,  Behavioral  Analysis  Service, 

Department  of  Psychology, 

Wilfcrd  Hall  USAF  Medical  Center 
Edna  Fiedler,  Behavioral  Analysis  Service, 

Department  of  Psychology, 

-Wilford  Kali  USAF  Medical  Center 
A.  David  Mangelsdorff,  Health  Services  Command, 

Fort  Sam  Houston.  TX 

Waiter  Sipes,  School  of  Aerospace  Medicine, 

Brooks  AFB.  TX 

Traoitionaliy  arena  of  organcationa!  consultation  is  viewed  as  the  applications 
area  for  indastrial,  organixationai  psychology.  However,  elements  such  as  common 
base  of  training,  Omited  professional  resources  and  pfc^entive  applica*jc»ns  of 
psychology,  have  tended  to  move  clinical  psychotagy  into  the  organizaticnal 
consultation  role.  Within  the  military,  dinica!  psychologists  tend  to  be  larger  in 
numbers,  in  proxirnhy  to  operationai  organUations  and  dispersed  due  to  assignment 
to  base  medical  units.  Therefore,  they  are  potentially  more  responsive  lo  local 
demands  for  psychok>gicai  services. 

The  var^us  services  have  at  times  systemicaliy  addressed  demands  of  operational 
orgartizations  by  creating  spedaiized  mentad  health  units.  More  commonly,  individual 
psychologists  liave  responded  to  local  demands  and  their  own  interests.  Examples 
of  the  former  are  the  Army's  cfiviston  osycjhologists.  Pilot  or  military  police  stress 
management  programs  offerod  to  local  squadrons  represent  the  latter.  The  scope 
and  effectiveness  of  these  vsvious  involvements  have  been  inadequately 
documented  and  explored.  There  reason  to  believe  this  process  may  portend  a 
greater  integration  of  the  various  specialties  of  psychology. 

The  purpose  of  this  panel  is  to  explore  various  elements  of  this  procsss  of  clinical 
involvement  in  military  organizational  consuHation  and  its  implications. 
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401^  ASE  IHE  HJPIDS  OF  TUB  SORVIVt^? 

iiTC  Hobart  K  >  Gifford,  Ph .  D . ,  D .  S .  Arnty 
LXC  Jaoas  S.  McCarrolX/  Pb  O.,  U.S.  Axta^ 

CEi  Pwiil  7.  Barto&e,  Ph.D.  U.S.  Army 

tfaltftr  Stefid  Amy  Xnatituto  of  Heoearcb 

Mazy  P.  ^ler,  Ph.D. 

M&J  Robert  J.  Przyboleici,  M.D.,  U.S.  Army 

U.S.  Army  Medical  Research  Unit  -  Eurt^>e 

:llh«n  hhezpect:sci  deaths  occur  in  a  military  unit,  there  is  great 
StreiMl  on  the  aur7-ivors,eho  are  esqsected  to  continue  to  perform 
th^ir  Miltary  dot  lea  %^le  resolving  their  grief  and  coming  to 
;gripa  vi^  memories  of  events  that  evplced  shock  and  often  terror, 
^searchers  iCrom  the  Walter  Reed  Army  Institute  of  Research  euid  the 
U.S.  Amy  Medical  Research  Unit  **  Europe  have  stxidied  the  recovery 
of  units  and  individuals  after  fatal  training  accidents,  aircraft 
crashes,  and  combat.  Findings  regarding  the  special  needs  of 
different  groups  of  survivors  -  including  friends  of  the  deceased, 
uj3it  leaders,  medii:^  per^oxuiel,  body  handlers,  and  casualty 
assistance  personnel  -  are  discxisaed. 


Stress  on  Military  Leaders  after  Sudden  Death  in  the  Unit 


LTC  Robert  K.  Gifford,  Fh.D. 


Leaders  of  military  units  that  have  just  suffered  fatalities  must 
attend  to  the  morale  of  aurviving  members  of  the  uxiit  while 
restoring  the  unit  to  full  mission  capability.  Further,  they 
typically  have  to  do  this  in  the  midst  of  investigations  and  while 
under  public  scrutiny.  Trcquently  this  creates  a  situation  in  which 
the  leader  ei^urea  that  everyone  in  tha  xmit  gets  excellent  social 
and  psychological  support,  but  there  is  no  one  to  support  the 
leader.  The  lack  of  sujpport  for  leaders  steais  both  from  &  eelf- 
isposed  ethic  of  setting  a  strong  exaspls  emd  from  the  fact  that  in 
many  settings  the  leaders  have  no  local  peers  to  provide  social 
support.  Leaders  develop  a  variety  of  mechanisms  to  cope  with  this, 
including  learning  to  draw  strength  from  their  soldiars,  talking 
with  chaplains,  and  confiding  in  their  spouses.  Research  suggests 
that  their  are  eeveral  ways  in  which  the  psychologist,  or  other 
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interfering  with  the  unit's  recovery  process. 


Medie&ll^.  Stnus  After  Faial  Military  Ttaisib 
MAJ  Robert  J.  Frzybelski,  MX>. 

p<arsomtel  respond  fatal  culitaxy  trsiimig  a«;t(tents  experience  ext^^ 
poiplulaM  jaxtfeaskmal  revive  croi^bed  or  dismembered  buddies 

and^rvmds  look  on.  Our  studies  of  five  such  accidents  have  found  duu 
SiK;[»d.bOdi|^cmal^&^  critical  for  the  well  being  and  continiied 

cfr^ve  foncQon  of  die  mMical  personnel  after  these  expoiences. 

Medical  corpsmen  received  personal  support  from  unit  members  and  peers  also  giievicg 
the  k:»s.tltei^(»$ional  support  that  hclpM  the  corpsmen  cope  withtl^  dcathofdmir 
pa^tmts  caxac  by  way  of  medical  debriefings  provided  by  their  supervising  pbysteian 

In  .cootmt,  the  physici^  assistants  had  no  peers  locally  to  assist  teem  through  the 
grieving  proem.  Regarding  their  professional  needs,  no  patient  fidlow-ups,  feedback  on 
care |)rovided,  orautopsy  reports  were  Voided  teem  by  tee  accepting  medical  facility 
physteians.  l&ck  of  suj^xat  pctnnpted  an  ov^ly  critical  self-«valaation  and  unfounded 
concdtns  regarding  the  apprppriatene:^  of  the  care  they  provided.  The  resulting  loss  of 
setf*assumnce  adversely  affected  tee  physician  assistants*  quality  of  life  as  wdl  as 
dteir  i^^ty  to  jrovide  l»alih  care. 

Recommendations  to  sigiervisors  of  these  health  care  providers  include  tee  fcdlowing: 
provide  a  uKdical  debnefing  for  each  level  of  provi^  as  soon  as  possible  after  tee  fatal 
traimng  accident  eiqietienc^keq)  tee  forward  medical  persmmelinfonned  of  the  status  of 
tee  pahents  teey  caiM  for,  including  tee  findings  any  autt^sies  performed. 


Fatal  lYaimug  Accidents:  Bereaved  Fiiemis 
Mary  P.  Tyler,  KU). 

Close  friends  of  deceased  soldiers  experience  a  significant  and  painful  loss.  They  also 
receive  stremg  suppon  frcmi  peers  and  co-workers,  and  can  play  a  key  role  in  tee  unit’s 
recovery.  a  study  t^fcnir  fatal  training  aetteients  in  Army  cm:^t  units  sug^st 

teat  tee  primary  need  of  close  fidends  is  to  be  left  with  their  uitit,  so  that  a  naturally 
oconring  hsalmg  process  can  take  place. 

M^tein  tee  frarnework  of  work  gro^  and  fiiendship  groups,  the  needs  of  bereaved 
soldi^  are  usually  recognized  very  quickly  by  their  pem  and  leadm.  Initially,  those 
most  affected  are  held  and  cmnforted.  Later,  they  receive  visits  from  less  bereaved 
soldiers,  and  talk  togeteer  in  informal  groups  to  work  through  tlmir  grief  and  trauma. 

Infom^  grmip  rituals  such  as  making  scrapbooks  for  tee  deceased  soldier’s  family  also 
ctmtnbote  to  recovov.  The  memorial  ^remony  and  other  fonnal  rituals  are  helpful  in 
providing  a  sense  of  closure,  an  qiportuniQ'  to  express  strong  feelings  in  an  apprt^mate 
mivircmment,  and  an  afiirmation  of  group  unity  and  shared  v^oes. 

Besides  receiving  support  frmn  odter  unit  membm,  tee  most  bereaved  soldiers  have  a 
unique  mmoatunity  to  fu^tate  unit  recovery.  The  most  bereaved  are  perceived  as  having 
a  special  license  to  forgive  those  troubled  by  guilt,  e.g.  unsuccessfril  rescuers,  and  to 
urge  tee  unit  to  return  to  duty  in  honOT  of  tee  deceased.  Unit  members  find  formal  rituals 
mms  meaningful  and  comforting  if  the  most  bereavwi  play  a  signi&am  role. 
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Ad^resiing  .;tiie  Heeds,  or  Body  Handlers  Following  Mass  Death 

James  E.  McCarroll,  Ph.D. 

Defyartiaent  of  Military  Psychiatry 
Walter  Reed  Army  Institute  of  Research 
Washington,  D.  C.  20307-5100 

Robert  J.  Orsano,  M,  D. 

Professor  and  Associate  Chairman 
l>epartment  of  Psychiatry 

Uniformed  Services  University  of  the  Health  Sciences 
Bethesda,  MD  20814-4799 


Military  personnel  can  be  called  upon  to  provide  assistance 
when  mass  death  occurs.  The  circumstances  of  such  calls  for 
assistance  are  almost  always  unexpected  and  people  are  called 
upon  to  j^rform  tasks  for  which  they  have  had  no  training  or 
preparation.  The  presentation  will  be  oriented  to  actions  and 
decisions  that  need  to  be  considered  by  comwand  in  the  event  that 
a  military  unit  or  installation  is  involved  in  the  processing  of 
bodies.  This  paper  will  describe  some  activities  of  military 
personnel  following  recent  disasters  and  the  reactions  of  some 
people  to  their  experiences.  We  will  describe  the  major 


stressors  that  are  likely  to  be  encountered,  the  range  of 
reactions  of  people  during  and  after  such  an  event,  and  actions 
that  might  be  considered  by  comxaand  in  the  form  of  a  brief 
disaster  human  resources  management  plan. 
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ASVSTENIS  APPROACH  FOR  IMPROVING 


OF  MILITARY  SYSTEMS 


Hal  W.  Hendrck,  f^D. 
Ogden  Bfcwn,  Jr.,  Ph.D. 
UnK'ereity  of  Denver 

Andrew  tmada,  Ph.D. 
f4ajmedin  Meshkati,  Ph,D. 
Uf^era^  of  Southern  California 


Summary 


The  concept  and  basic  dinwtsions  of  macroergonomics  are  reviewed. 
Macroet^nortiics  m^hods  such  as  organizatioral  and  work  systems  ana'ysts  and 
participatory  ergonomics  are  reviewed.  U.S.  and  sntemational  examples  are  presented 
from  the  panefets'  research  and  e)qierfenc6.  Macroergonomics  Issues  arxi  potential 
applications  in  the  m^iary  «i\nrc»Tment  ^e  discussed. 


PAHEL  PBOPQSAL: 

APPSOACEDES  TO  STODYIHG  CEE»  PKODDCTIVITY  AND  GRODP  PROCESSES 
USING  HIGH  FIDELITY  FLIGHT  SIMULATORS 


In  recent  years,  the  use  of  flight  simulators  in  aviation 
training  has  expanded  (Foushee,  Chidester  &  Helmreich,  1988) . 
Flight  simulators,  however,  also  have  applications  for  research 
since  they  provide  a  way  of  studying  detailed  behavioral 
sequences  and  communication  patterns  which  would  not  be  possible 
in  actual  line  operations.  The  development  and  use  of  full 
mission  simulator  scenarios  could  aid  researchers  in  examining, 
under  controlled  conditions,  such  things  as  crew  productivity, 
group  processes,  crew  coordination  and  leadership  (Foushee,  et 
al.  1938) .  The  proposed  psuiel  will  attempt  to  highlight  the 
vaurious  ways  high  fidelity  simulators  can  be  used  to  study 
aspects  of  aircrew  productivity  and  coordination. 

Each  panelist  has  conducted  research  using  data  from  a  high 
fidelity  B-727  aircraft  simulator  in  a  KASA-Ames  simulation 
facility.  The  panel  members  were  selected  because  they 
illustrate  different  methods  of  using  flight  simulators  to 
examine  crew  productivity  issues.  For  example,  Tom  chidester 
takes  a  fairly  traditional  experimental  design  approach  to 
excimine  the  relationships  between  input  variables  (i.e., 
personality)  and  outcomes  (i.e.,  measures  of  team  performance); 
Steve  Predffiore,  B2a±»ara  Kanki  and  Sharon  Conley,  in  contrast, 
use  more  exploratory  methods  to  examine  the  group  processes  that 
mediate  such  relationships.  Regeurdless  of  the  specific  focus  or 
approach,  the  method  of  using  simulator  data  to  examine  aspects 
oif  crew  processes  and  performance  is  common  across  presenters. 

The  panel  session  will  be  designed  to  encourage  comments  and 
discussion  from  the  audience.  Robert  Ginnett  will  serve  as 
chair  of  the  session.  The  panelists  are  as  follows: 

1.  Thomns  R.  Chidester  (RASA-'Ames,  Moffett  Field)  c  Tom 
Chidester  will  present  a  simulator  study  examining  the 
impact  of  crew  selection  along  dimensions  of  personality  on 
crew  effectiveness.  The  study  design  includes  the  use  of  a 
"cluster  smalysis"  method  to  cluster  personality  traits 
(Instrumentality,  Expressivity  and  Achievement  Striving) 
into  general  constructs.  This  simulator  study  provided  a 
database  for  the  more  exploratory  studies  of  group  processes 
conducted  by  Predmore,  Kanki  and  Conley. 


Steve  Predmore  (Univc:rsity  of  Texas,  Austin) .  Steve 
Predmore  will  discuss  the  design  and  findings  of  his  study 
examining  how  crews  attend  to  abnormal  operations  and 
interruptions  during  simulated  flight.  He  uses  am 


effective  crews. 
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BAzSMUrtt  6.  XzmXi  (HAS&~A»es,  Moffett:  Field) .  Barbara  Kanki 
Vill  dlscoss  the  use  of  a  sixiulator  design  to  exzunine 
overall  ooeaen icat ion  patterns  that  differentiate  more  and 
less  effective  crews.  The  study  focuses  specifically  on 
interactive  behavioral  segi^nces  and  the  way  in  which 
coaomnicacion  patterns  mediate  the  effect  of  personality  on 
group  performance. 

Sharcoi  C.  Conley,  (University  of  Arizona) ,  Don  Bryant  (NASA- 
Ames,  Moffett  Field) ,  and  Yvonne  Cano  (University  of 
Arizona).  Sharon  Conley,  Don  Bryant  emd  Yvonne  Cano  will 
report  the  design  and  findings  of  their  study  examining  crew 
dynamics  of  mere  and  less  effective  crews.  The  research 
contrasts  four  three  person  crews  flying  three  legs  of 
flight  in  an  aircraft  simulator.  The  study  specifically 
examines  informal  group  processes  that  facilitate  task 
coordina t ion . 

Kathy  Mos^r  O’NeiiS  (University  of  California  at  Berkley).  Kathy 
Mosier  O'Neitt  will  dlscu  js  team  and  expert  decision  making  strategies,  use  of 

Information,  and  the  infiuence  of  personality  or.  the  decision  making  process. 


Panel  Discussion  of  iikircrew  Perforaance  Measurement  Issues 

Wayne  L.  Wetag 
Herbert  H.  Bell 

Air  Force  Huiaan  Resources  Laboratory 

Richard  W.  Obermayer 
Donald  Vreuls,  Panel  Discussant 
VRC  Coirporation 

Anthony  P.  Ciavarelli 
Navy  Postgraduate  School 

Marty  R.  Rockway 
Gary  S.  Thomas,  Panel  Chair 
University  of  Dayton  Research  Institute 


The  training  applications  of  aircrew  performance  measurement 
are  numerous.  Valid  and  reliable  measures  are  needed  for  such 
purposes  as  (l)  perfoxmeuice  feedback  to  the  instructor  emd  the 
student,  (2)  student  p^fcrmance  diagnosis,  (3)  student  performance 
assessment  aund  grading,  (4)  training  system  evaluation  zuid 
manageaent,  and  (5)  prediction  of  job  performance.  Different  types 
of  performance  mesusures  are  often  necessary  depending  upon  the 
proposed  use  of  the  measures  in  the  training  environment.  The 
development  of  adequate  performance  measures  is  also  required  for 
research  and  development,  applications.  For  example,  sensitive 
measures  are  needed  to  evaluate  the  effectiveness  of  new  training 
methods  and  training  media  such  as  simulators  and  part-task 
trainers. 

The  panel  members  discuss  why  perfonaance  measxxrement 
development  has  lagged  behind  the  technology  available  for 
recording,  analyzing,  and  displaying  performance  data.  Fundamental 
problems  in  measurement  development  include:  the  lack  of  a  general 
theory  of  human  performance,  establishing  criteria  and  standards 
for  performance,  determining  the  validity  of  performance  measures, 
and  the  fact  that  important  components  of  performeuice  are  not 
observzd:tle.  Discussion  includes  lessons  learned  in  performance 
measurement  development  research,  techniques  and  methods  for 
establishing  reliability,  validity,  and  useability  of  measures,  and 
the  role  of  the  human  observer  in  performance  assessment.  Panel 
members  also  present  the  results  of  ongoing  performance  measurement 
research  and  guidelines  tor  future  performance  rneasuremeni:  efforts. 


Panel 


Ca^^vascular  Reactivity  in  a  MiUtaiy  & 
U.S.  Qovemmofti  Civilian  Population 


Robert  0.  Hindelar^ 
Tommid  G.  Cayton 
National  Defense  University 


Suzin  E  Ms^erson 


Uniform  Service's  University  of  Health  Sciences 


Two  taandred  lifty'One  male  subjects  (207  military  offtcers  and  44  government 
Ct^fiuns}  vrere  administered  cardiovascuiar  reactivity  testing  as  part  of  a  health  risk 
.^|>praisal.  Readivtty  testing  consisted  of  mental  arithmetic  and  video  game 
'  dt^Qaoges  during  which  blood  pressure  and  heart  rate  were  recorded  at  one  minute 
Intervals.  Thirty-frve  percant  of  the  lota)  populMon  exceeded  the  ciink:ai  criterion, 
mean  arterial  blood  pressure  of  107.  Officers  were  less  reactive  than  civilians; 
however,  there  were  no  differences  among  military  services.  Separate  analysis  of 
task  dialienges  indicated  officers  were  significantly  less  reactive  on  mental 
arithmetic.  These  groups  did  not  differ  on  resting  blood  pressure  but  civilians  had 
greater  resting  heart  rate  and  were  also  signiticantty  older.  After  adjusting  for  the 
effeds  of  e^e  and  heart  rate,  no  group  re^vity  differences  were  found.  These 
resiits  win  be  discussed  in  tight  of  posable  effects  of  military  attributes  as  well  as 
measurement  issues  of  cardiovascular  reactivity. 


Miiitai>'  Officers  in  Human  Factors  Engineering: 

Responsibilities,  Roles,  and  Realities 

In  December  1988,  DOD  Directive  5000.3,  Manpc-A'cr,  Personnel,  Training  and  Safety  in 
the  Defense  Acquisition  Process,  was  approved,  man^ting  that  all  DOD  components  in 
coc^)cration  with  industry  adhere  to  human-system  integratitm  objectives.  5000.3  states:  "The 
DC®  shall  maximtre  the  operational  effectiveness  of  all  systeoii ...  by  ensuring  those  sy&tems 
can  be  effectively  operated,  maintained,  and  supported  by  well  qiiaiifi:^  and  trained  people. 

To  do  so,  human  capabiiides  ana  iimitations  mast  be  fully  considered  early  in  the  systems 
design  process".  Key  resources  within  DOD  for  supporting  human  factors  research  and 
implementing  human  engintaing  ia  systems  design  and  acquisition  are  its  behavioral  scientists 
and  psychologists  in  uniform.  Tae  purpose  of  this  panel  is  to  triltc  a  Tri  -Service  look  at  what  it 
means  to  be  a  military  offiem-  involved  in  the  specialized  field  cf  human  factors  engineering. 
Issues  to  be  treated  icciut'e:  arc  cr  should  be  well-defined  career  paths  for 

military  human  factors  engineers;  unique  <.;pportunitics,  as  well  as  drawbacks  and  limitations, 
associated  with  being  a  military  human  factors  engineer,  and  typical  job  descriptiwis, 
compared  with  the  apprc^i^c/ideal  utilization  of  these  personnel.  The  panel  conclude  by 
assessing  the  current  impaa  of  human  factors  engineering  on  the  acquisition  and  design 
process,  and  by  addressing  the  controversial  question  of  whether  or  not  the  DOD  even  needs 
military  rcpreseitation  among  its  human  factors  engineers. 

Proposed  Panel  Members 

Moderator.  Lieutenant  Kristen  Mortmi.  US aF 
Harry  G.  Armstrong  Aerospace  Medical  Research  Laboratory 
Wright-Patterson  AFB,  OH  45433-6573 
AV  986-7142 

♦♦Lieutenant  Colonel  Gerald  P.  Krueger,  USA 
US  Army  Aeromedical  Research  Laboratory 
Fort  Rucker,  AL  36362-5292 
AV  558-6866 

Lieutenant  Colonel  William  P.  Marshak,  USAF 
Harry  G.  Armstrong  Aerospace  Medical  Research  Laboratory 
Wright-Patterson  AFB,  OH  45433-6573 
AV  785-7555 

Lieutenant  Colonel  Thomas  McCloy,  USAF 
Department  of  Behavioral  Sciences  and  Lxadership 
US  Air  Force  Academy,  CO  80840-5701 
AV  259-4305 

Lieutenant  Commander  Thomas  M.  Mitchell,  USN 
Naval  Postgraduate  School 
Monita’cy,  CA  93943 
.AV  878-2620 

Captain  JackD.  Mohney,  USAF 
.AeronautirviJ  Systems  Divi.sion  (ASD/ALH) 

Wright-Patterson  AFB,  OH  45433-6.703 
AV  785-9750 
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A  Structural  Assassnant  oV  classroom  Learning 


Tissothy  E.  ColdsBith,  Ph.D. 
University  of  Neu  Mexico 


Abstract 

This  paper  describes  a  technique  for  assessing  classroom  learning 
based  on  a  student’s  judgments  of  the  Interrelationships  among  the 
central  concepts  of  a  dootaln.  These  judgments  are  subject  to  a 
scaling  technique  (Pathfinder)  to  produce  a  conceptual  network.  The 
network  Is  hypothesized  to  reflect  Important  characteristics  of  what  an 
Individual  knows  about  the  dot&aln.  This  hypothesis  was  supported  by 
demonstrating  that  network  structures  of  better  students  are  indeed  more 
similar  to  an  idealized  referent  structure  of  the  domain  than  poorer 
students. 


TO'be  knowledgeable  in  sane  area  is  to  understand  the  Interralatlonshlps 
among  the  important  ccmcepts  in  that  domain.  It  Is  a  long  standing  assumption 
within  cognitive  and  educational  psychology  that  this  organizational  property 
of  knowledge  can  best  be  captured  with  structural  representations  (e.g. , 

Bower,  1972;  Collins  &  Quilllan,  1963).  A  fundamental  problem  with 
conventional  educational  assessment  procedures  Is  that  they  are  In  principle, 
Incapable  of  explicitly  representing  this  conflgural  property  of  knowledge. 
Rather,  classroom  learning  Is  assessed  In  terns  of  percentage  correct,  or  In 
the  case  of  standardized  tests,  a  percentile  ranking  within  some  designated 
population,  in  some  Instances  performance  may  be  analyzed  Into  subscales,  but 
for  the  most  part  learning  Is  represented  In  terms  of  a  unidlmensional  scale 
reflecting  the  student’s  relative  class  standing. 


The  need  for  procedures  that  assess  and  represent  conceptual  properties 
of  classroom  learning  was  recognized  as  early  as  1972  by  Shavelson  and  his 
colleagues  (Shavelson,  1972;  1974)  who  took  the  view  that  classroom 
instruction  is  most  properly  seen  as  the  communication  of  a  specific  structure 
that  Is  iR^lldt  within  the  curriculum  of  a  subject  matter.  Shavelson 's  work 
provided  the  impetus  for  a  slowly  developing  literature  investigating  the 
relationship  between  derived  cognitive  stnictures  and  domain  performance 
(e.g.,  Naveh-Benjanin,  HcKeachle,  Lin,  &  Tucker,  1986).  Unfortunately,  most 
of  this  work  has  suffered  from  one  or  more  problems.  First,  the  data  on  which 
the  cognitive  structures  were  derived  were  averaged  across  subjects  and 
therefore  failed  to  assess  Individual  students.  If  this  approach  Is 
eventually  to  be  used  in  the  classroom  it  must  be  applicable  to  individual 
students.  Second,  the  assessment  procedures  often  required  students  to 
directly  report  the  organization  of  their  structure.  There  are  reasonable 
concerns  (e.g.,  Nisbett  &  Wilson,  1977)  as  to  whether  we  have  direct  conscious 
access  to  cognitive  structure.  Third,  the  derived  structures  were  often 
assumed  to  be  hierarchical.  Hierarchical  structures  may  be  appropriate  for 
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solution  to  a  hierarchical  representation.  Finally,  the  basis  for  comparing 
the  similarity  of  structures  was  ofton  subjective.  Ideally,  we  would  «nploy 
an  objective  quantitative  means  of  assessing  the  similarity  of 
representations. 


Of  the  many  behavicral  changes  that  may  occur  with  the  acquisition  of 
expertise,  we  are  particularly  interested  in  judgments  of  relatedness  among 
central  concepts  within  the  relevant  domain.  This  set  of  relatedness 
judgments  1s  assumed  to  reflect  the  state  of  an  individual’s  knowledge.  This 
assumption  is  tested  by  examining  the  predictive  validity  of  such  relatedness 
judgBents^  However,  rather  than  attempt  prediction  with  the  raw  ratings,  the 
history  of  psychological  scaling  suggests  that  transformations  of  the  ratings 
win  prove  more  useful.  Therefore,  a  major  effort  of  our  work  in  classroom 
assessment  has  been  to  determine  which  transformations  of  concept  ratings  have 
greatest  predictive  validity.  The  preference  of  one  transformation  ever 
another  is  determined  first  by  its  validity  as  a  predictor  of  domain 
performance  and  second  by  its  representational  simplicity  relative  to  the 
complete  data.  In  the  present  study  we  are  specifically  interested  in 
determining  whether  Pathfinder  (Schvane veldt,  Durso,  &  Dearholt,  1985) 
networks  have  greater  predictive  validity  than  raw  relatedness  ratings  or 
multidimensional  scaling  (HDS)  derived  representations. 

To  assess  the  predictivenss  of  a  student’s  cognitive  structure  we  need 
some  means  of  objectively  comparing  a  student’s  representation  with  some 
Idealized  referent  representation,  which  in  the  present  work  is  obtained  from 
the  instructor.  In  the  case  of  raw  relatedness  ratings,  we  may  simply 
calculate  the  product -moment  correlation  (this  and  all  subsequent  correlations 
are  Pearson  correlations)  between  corresponding  values  in  the  student's  and 
instructor’s  ratings.  For  MDS  representations,  we  first  calculate  the 
euclidean  distance  between  all  pairs  of  points  in  the  n-dimensional  space  and 
than  calculate  the  correlation  between  corresponding  distances  in  different 
representations,  A  similar  approach  is  used  to  compare  Pathfinder  networks 
but  now  graph-theoretic  distances  between  nodes  in  the  derived  networks  are 
correlated.  A  second  similarity  measure  for  networks  is  a  set-theoretic  Index 
of  closeness  (C)  described  by  Goldsmith  and  Davenport  (In  press).  Briefly,  C 
examines  the  degree  to  which  the  same  node  in  two  graphs  Is  surrounded  by  a 
similar  neighborhood  of  nodes.  The  values  of  C  range  between  zero  (for 
complementary  graphs)  to  one  (for  isomorphic  graphs).  C  Is  assumed  to  assess 
structural  (1.e.,  configural)  similarity  of  graphs,  and  therefore  we 
hypothesize  that  C  applied  to  Pathfinder  networks  will  indeed  allow  higher 
predictive  validity  of  student  knowledge  than  other  r<»presentat1 on/comparison 
methods. 

The  basic  purpose  of  the  study  was  to  assess  whether  the  degree  of 
agreement  between  a  student’s  structure  and  the  instructor’s  structure  was 
indicative  of  classroom  performance  as  measured  by  conventional  testing 
techniques.  We  hypothesized  that  students  whose  structures  more  closely  match 
the  instructor’s  will  indeed  be  more  knowledgeable  and  hence  perform  better  on 
standard  examinations.  We  further  hypothesized  that  a  measure  of 
representational  similarity  that  assesses  configural  relationships  of 
knowledge  elements  will  be  mere  predictive  of  performance  than  one  not  based 
on  configural  information. 


Method 


Subjects  and  Domain 

A  total  of  40  students  from  a  16-week  sophotnore/junior  level  college 
course  on  psychological  research  techniques  participated  in  tfte  study  with  20 
students  coming  from  each  of  two  separate  courses  taught  in  different 


samest^'rs  by  the  saae  instructor.  A  sot  of  30  central  concepts  in  statistics 
ahrf  axperlcwntal  design  was  selected  by  the  instructor  In  coTijunction  with 
other  faculty  in«»bers  who  taught  related  courses.  Student  perfonnance  in  the 
course  was  measured  by  three  exams  and  two  papers  totaling  4£0  points. 

Pr<ai?<jj4rj£ 

The  purpose  of  the  concept  rating  project  was  explained  to  students  at 
the  beginning  of  the  semester.  They  were  told  they  would  rate  the  relatedness 
of  43S  (30*(30-1)/2)  pairs  of  concepts  at  the  end  of  the  semester,  and  that 
these  ratings  would  be  used  to  assess  their  knowledge  of  the  course  material. 
Students  ware  allowed  to  earn  up  to  20  extra  course  points  by  performing  well 
on  the  task.  Students,  performed  the  task  individually  and  at  their  own 
convenience  on  microcomputers  located  around  campus.  The  course  Instructor 
also  rated  the  concepts  to  provide  a  referent  structure. 

Students  were  asked  to  judge  the  relatedness  of  each  pair  of  concepts 
using  a  T-point  scale  where  “1“  corresponded  to  less  related  and  “7“  to  more 
related.  Students  were  first  shown  the  complete  set  of  concepts  and 
encouraged  to  pick  out  concept  pairs  that  were  highly  related  or  highly 
unrelated  to  serve  as  anchors.  Each  pair  of  concepts  appeared  left-right 
centered  below  the  rating  scale.  A  bar  marker  appeared  Initially  at  rating  “4” 
for  each  concept  pair.  The  bar  marker  could  then  be  moved  with  the  left  and 
right  directional  keys  on  the  computer  i^yboard  to  select  the  desired  rating. 
Pressing  the  space  bar  accepted  the  rating  and  presented  the  next  pair  of 
concepts.  The  presentation  order  of  the  concept  pairs  was  randomized 
individually  for  each  subject.  Additionally,  the  left-right  order  of  the 
concepts  was  randomized  for  each  pair.  On  average,  students  took  about  one 
hour  to  complete  the  set  of  ratings. 


Results 

Data  from  both  classes  were  combined  and  analyzed.  The  concept  ratings 
were  first  converted  to  prcximitles  by  subtracting  each  rating  from  eight. 
These  proximities  were  then  analyzed  by  Kruskal’s  (1964)  ncnmetric  MDS 
procedure  and  Pathfinder.  In  the  case  of  MDS,  an  elbow  criterion  test  yielded 
four  dimensions  as  optimal  and  so  all  subsequent  MDS  analyses  are  based  on 
four  dimensions.  Once  the  HOS  and  Pathfinder  representations  were  obtained, 
the  similarity  between  each  student’s  representation  and  the  instructor’s  was 
determined  using  the  methods  described  previously.  Comparisons  were  made  from 
each  student’s  data  using  each  of  four  different  knowledge  Index  variables: 
correlations  on  raw  ratings,  correlations  on  KDS  distances,  correlations  on 
Pathfinder  graph-theoretic  distances,  and  Pathfinder  networks  assessed  by  C. 

To  simplify  reporting  of  the  results,  we  abbreviate  these  as  RAT,  MDS,  PFR, 
and  PFC,  respectively. 

Agreement  between  each  student  and  the  Instructor  was  computed  based  on 
the  four  ki'jowledge  Index  variables.  Correlations  ware  then  computed  between 
each  knowledge  index  var<able  and  the  student’s  earned  course  points  at  the 
end  of  the  semester.  The  resulting  correlatioris,  transformed  into  r-squared 
values,  for  RAT,  MDS,  PFR,  and  PFC  were  .37  .29,  .43,  ana  .56  respectively. 

The  correlations  were  all  significant  {b<.01).  The  correlation  between  a 
student’s  and  instructor’s  concept  ratings  (RAT)  accounted  for  37t  of  the 
variance  associated  with  the  student’s  final  course  grade.  Hence,  concept 
ratings  themselves  are  a  valid  indicator  of  a  student’s  knowledge.  Of  more 


Is  whether  scaling  el sor1tiW!S  such  as  MDG  and  Patnfinder 
extract  frUB!  these  ratings  inforaatlon  that  allows  evei'i  better  predictions. 

The  ans^Kftr  varies.  Distances  frac  MDS  were  slightly  pccrer  XMnn  ratings  In 
predlctlT^  perfortaance  whereas  Pathfinder  distances  were  better  than  the 
ratings^  Camparisorj  of  Pathfinder  networks  with  C  (PFC)  provided  oysn 
better  predictions  than  with  correlations  (PfrJ). 

A  closer  look  at  the  relative  contribution  cf  each  knowledge  Index  for 
predicting  final  course  points  ccmes  froai  examining  partial  ccrrelatlons. 

Table  1  gives  cerrelation  between  each  Index  and  final  points  with  the 
variance  contributed  by  each  other  index  held  constant.  Coivsidar  first 
Pathfinder  networks  that  have  been  compared  using  C.  PFC  correlates 
significantly  with  final  points  even  when  each  of  the  other  variables  is  held 
constant.  However,  none  of  the  other  Indices  correlates  significantly  with 
course  shades  when  the  variance  contributed  try  PFC  is  held  constant.  This 
pattern  of  findings  strongly  suggests  that  Pathfinder  netwoi-ks,  as  assessed  by 
C,  are  uniquely  capturing  important  predictive  variance  in  the  concept 
ratings.  Consider  next  Pathfinder  networks  as  assessed  by  correlations.  PFR 
is  a  significant  predictor  when  ratings  and  HDS  are  each  held  constant,  but 
not  PFC. 


Table  1 

Partial  Correlations  Between  Knowledge  Index  1  and  Final  Course 
Points  with  Knowledge  Index  2  Held  Constant 


Knowledge  Index  2 


RAT 

MDS 

PFR 

PFC 

RAT 

- 

.34* 

.30 

.15 

Knowledge 

MDS 

.03 

- 

.29 

.12 

Index  1 

PFR 

.43** 

.52»a 

- 

.17 

PFC 

.54»» 

.6ia* 

.46»* 

- 

*  p<,05  »*  p<.01 


These  results  ioiply  that  Pathfinder  networks  do  indeed  contain  unique 
predictive  variance  over  the  ratings  and  MDS,  and  that  a  configural  assessment 
of  networks  is  a  better  index  for  assessing  network  similarity  than 
correlations.  Apparently,  C  better  reflects  ccomonal ities  between  structures 
that  happen  to  be  important  In  assessing  knowledge.  Me  assume  that  the 
characteristics  cotmon  to  a  student’s  structure  and  instructor’s  structure 
that  are  predictive  of  knowledge  attainment  exist  at  a  global  or  configural 
level  within  those  representations.  This,  of  course,  is  exactly  the  type  of 
Information  that  C  is  assuned  to  be  good  at  assessing. 


Consider  next  the  results  from  MDS.  Spatial  structures  did  not 
significantly  predict  course  performance  when  the  other  variables  were 
partialled  out.  MDS  has  been  successful  in  previous  applications  for 
nepresanting  physical  or  continuous  relations.  Our  results  may  indicate  a 
specific  limitation  of  HOS  for  assessing  conceptual -level  relations.  Some 
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Schvaneveldt  (1986)  who  ccxnpared  MDS  and  Pathfinder  In  representing  recall 
data. 


Olscusslon 


Ite  conclude  that  know’^edge  representations  based  on  college  students’ 
ccr»cept  ratings  do  indeed  offer  a  valid  assessment  of  -fisir  classroom 
learning.  The  extent  to  which  a  student’s  representatio.''  iiatches  that  of  the 
Tnstrucvor’s  at  the  er.d  of  the  semester  Is  a  good  Index  cf  hc>‘  much  knowledge 
the  student  nas  learned  about  the  domain  of  study.  Further,  the  predictive 
ability  depends  on  Iwiw  the  structure  is  represented  and  compared. 

The  cognitive  structural  approach  to  classraoui  assessment  has  an  obvious 
cofunectlon  with  much  of  the  expert-novice  research.  Both  approaches  take  a 
structural  repr^ntatlonal  view  of  domain-specif  ic  knowledge.  However,  one 
interesting -difference  is  that  the  expert-novice  -cork,  as  the  descriptor 
denotes,  compares  groups  that  differ  widely  in  skill  levels,  whereas  the 
present  work  attempts  to  discriminate  individuals  at  a  more  homogeneous  level. 
Our  results  show  that  it  is  possible  to  discriminate  onong  students  within  a 
coK«xn  level  of  expertise  and  describe  these  finer-grcin  differences  of 
perfc;‘o;ance  along  a  quantitative  continuum  M.e.,  similarity  to  the 
instruu  Ler’s  representation).  Although  this  Is  not  to  be  interpreted  as 
.auggostirg  that  qualitative  distinctions  are  unnecessai^y,  it  does  introduce 
the  possibility  that  at  sone  levels  of  analysis  expert-novice  distinctions  can 
be  seen  as  a  cotttinuous  transition.  More  relevant  to  the  problem  at  hand,  the 
pref^nt  flrdings  suggest  that  relatively  small  differences  in  classroom 
knowledge  can  be  discrioinateo  with  a  cognitive  representational  approach. 
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ABSTRACT 

Recent  changes  to  the  Professional  Military  Education  (IME) 
develcpment  for  Air  Force  officers  has  led  to  the  formation 
of  a  new  leadership  development  initiative  by  Strategic  Air 
Command.  The  Lieutenants  Professional  Development  Program 
(LPDP)  wes  started  by  SAC  to  bridge  the  gap  between  the 
lieutenants  pre-commissioning  training  and  attendance  at 
Squadron  Officers  School. 


Much  has  been  written  over  the  years  about  the  concept  of  leadership^ 
According  to  Air  Force  Pamphlet  35-49  (1985),  “Leadership  is  the  art  of  influ- 
eticlng  and  directing  people  to  accomplish  the  mission.  The  basic  concept  tne 
effective  leader  must  keep  in  mind  encompaeses  two  fiindamental  elements;  the 
mission  and  the  people.'  For  officers  in  the  Air  Foi'ce,  the  developtaent  of 
leadership  begins  during  one’s  pre-coaffilssioalng  program  (ie.  RCTC,  OTS,  APA^, 
and  ultimately  results  with  a  commission  as  a  Second  Lieutenant.  Once  on 
active  duty  as  a  lieutenant,  It  was  the  usun}  practice  to  begin  taking  yo’vr 
first  Professional  Military  Education  Course  (Squadron  Officer  School)  ty 
correspondence.  However,  with  recent  changes  to  the  Air  Force's  Professional 
Military  Education,  newly  coamissloned  officers  do  not  receive  any  further  for— 
oel  lesdcrsbip  development  training  until  they  reach  the  rank  of  captalr- 
Recognizing  the  gap  between  an  officer's  pre-commissioning  and  eligibility  to 
attend  Squadron  Officers  School,  the  CoBSuander  in  Chief  of  Strategic  Air 
Command  (CINSAC)  approved  the  establishment  of  the  Lieutenants  Profesf,lonal 
Development  Program  (LPDP). 


BACKGROUND 

The  original  LPDP  began  in  September  1979  as  a  test  program.  TJ'.e 
Commander  in  Chief  of  Air  Training  Command  (ATC),  concerned  about  the  signlfi- 
caat  nuiab«':r  of  lieutenants  in  key  leadership  and  supervisory  pceitiors  without 
any  practical  experience  or  specialized  maragement  training,  taskec  che 
Leadership  and  Management  Development  Center  (IMDC),  to  develop  and  provide  a 
pilot  prograa  for  selected  ATC  training  centers.  The  rational  for  the  program 
wss  that  new  officers  (particularly  from  BOTC  and  CTP)  graduating  from  largely 
acadeialc  oriented  programs  lacked  practical  leadership  and  officerahlp 
training.  The  basic  focus  of  the  LPDP  was  to  translate  leadership  and  manage¬ 
ment  theory  Into  &  program  where  iieutenants  could  practice:  a  "hands-on- 
employment  of  the  leadership  principles.  From  late  1979  until  May  1986,  IMDC 
MaivageahiDC  Consultant  Teams  conducted  the  prograsa  at  the  request  of  inttrested 
organizations . 


sac’s  Lieutenants  Professional  Development  Program 


As  stated  earlier,  with  the  change  to  the  Air  Force  RIE  policy,  the  CIMSAC 
approved  the  establishment  of  the  LPDP  for  all  SAC  lieutenants  on  25  July  1988. 
The  programs  objectives  were:  (1)  to  strengthen  an  officers  professional 
values ,  (2)  to  provide  a  foundation  for  further  officer  professional  develop- 
nent  and  (3)  to  translate  leadership/manageaent  theory  into  practical  applica¬ 
tion  to  better  prepare  officers  to  assume  their  responsibilities.  To  accomplish 
these  objectives,  the  LPDP  consists  of  a  five  day,  35-hour  program.  A  descrip¬ 
tion  of  the  LPDP  agenda  items  are  found  in  figure  1.  The  initial  15  hours  (two 
days)  is  contracted  out  to  a  civilian  university  (Eastern  Washington  State 
University)  and  is  taught  by  their  faculty.  The  primary  aim  is  for  the  lieute¬ 
nants  to  be  exposed  to  basic  management  and  organizational  theory.  Some  of  the 
topics  discussed  are:  characteristics  of  organizations  and  leadership, 
decision-making,  motivation,  stress  management,  human  communication  and  facili¬ 
tating  task  groups.  Various  classroom  simulations  and  exercises  are  incor¬ 
porated  into  the  two  days  to  enhance  student  learning.  Recent  studies 
(O’Callaghan, 1989)  have  shown  that  this  approach  has  proved  to  be  a  very  effec¬ 
tive  tool  in  converting  management  theory  to  real  world  situations  routinely 
faced  by  lieutenants. 

The  two  day  workshop  conducted  by  the  university  instructors  is  followed 
by  a  three  day,  20-hour  block  of  instruction  facilitated  by  a  senior  Air  Force 
officer.  Here  the  primary  focus  is  on  leadership  and  officershlp.  According 
to  Vice  Admiral  James  8.  Stockdale,  United  States  Nav  (Ret.)  (1982)  the  con¬ 
cept  and  importance  cf  leadership  is  critical  to  an  officer.  He  states: 

In  all  that  I  have  been  saying,  I've  made  the  points  that 
leaders  under  pressure  must  keep  themselves  absolutely 
clear  morally.  They  must  lead  by  example,  must  be  able  to 
Implant  high-mindedness  in  their  followers,  must  have 
competence  beyond  status,  and  must  have  earned  their 
followers  respect  by  demonstrating  integrity. 

In  an  effort  to  address  these  and  other  leadership  Issues,  a  variety  of 
topics  are  discussed  during  the  20  hours  of  instruction.  These  include:  the 
elements  of  officership;  the  Impact,  importance  and  development  of  individual 
values;  the  importance  of  ethics;  situational  leadership;  and  small  group 
discussions  with  the  Wing  Commander,  senior  officers,  senior  NCO's  and  officers 
from  the  sister  services  on  pertinent  leadership  issues.  The  goal  of  these 
diccusaions  is  to  enable  our  junior  officers  to  think  about  and  act  on  their 
owTi  leadership  styles.  Concerns  about  officers  not  being  able  to  think  beyond 
the  scope  of  black  and  white  issues  has  been  evidenced  in  a  research  study  con¬ 
ducted  by  Bryant,  O'Caliaghen,  Buron  and  Lorenzen  (1988).  The  SAC  LPDP  is 
designed  to  help  officers  think  in  the  abstract  (grey  areas)  and  to  better  deal 
with  a  variety  of  decisions  required  as  nupervisers  and  managers. 


Summary 

The  LPDP  is  now  conducted  at  all  SAC  bases.  Its  goal  is  to  have  all 
lieutenants  assigned  to  SAC  to  complete  this  course  prior  to  being  promoted  to 
Captain.  The  critiques  from  the  participants  that  have  completed  the  LPDP  have 
been  extremely  positive.  For  many  cf  thee,  the  importance  of  the  program  can 
be  sumnied  up  in  tha  words  of  one  lieutenant's  comments  on  the  course  critique. 
When  asked  what  the  most:  benefit! cal  aspect  of  the  program  was  to  them,  the 


FIGURE  1 


Description  of  LPDP  Agenda  Items 


Workshop  Introduction 


Administrative  details  for  Eastern  Washington  State  University  are  accomplished 
during  this  time,  followed  by  an  overview  of  the  LFDP. 

Getting  Acquainted  Exercise 

This  exercise  consists  of  each  workshop  participant  telling  everyone  else  in 
the  group  what  their  most  embarrassing  moment  was  in  ROTC,  OTS,  AFA,  Charm 
School,  or  active  duty;  three  adjectives  that  describe  themselves;  the  finest 
leader  they  know  and;  their  symbol  for  leadership.  This  exercise  is  designed 
to  both  "break  and  ice"  and  to  allow  the  members  of  the  group  to  know  a  little 
more  about  each  other. 

Transition  on  being  a  Manager 

This  lecture  and  discusalcn  describes  the  new  roles  as  managers  lieutenants 
take  on  as  a  result  of  their  commission  into  the  Air  Force.  Factors  they  must 
face,  planning  and  organzlng  issues  are  looked  at. 

Setting  Goals 

This  session  deals  with  the  Importance  of  goal  setting  and  maintaining  stan¬ 
dards  for  running  an  effective  organization.  Problems  faced  by  not  taking  time 
to  set  goals  will  also  be  discussed. 

Characteristics  of  Organizations 

This  lecture  and  discussion  will  focus  on  the  importance  roles  and  norms  play 
in  organizations.  Typical  behaviors  that  characterize  a  person  in  a  specific 
social/work  context  as  well  as  a  look  at  the  generally  agreed  upon  informal 
rules  that  govern  and  guide  group  members  behavior  will  be  discussed. 

Coaanuni cat  Ions 

This  exercise,  known  as  "the  Domino  Game,"  is  designed  to  test  the  ability  of 
the  workshop  participants,  to  communicate  complex  information.  Most  par¬ 
ticipants  find  it  fun  and  exciting  and  will  continue  the  game  as  long  as 
allowed. 

Organizational  Theory 

This  lecture  will  expose  participants  to  e  sampling  of  motivational  theories 
and  applied  to  such  areas  as  performance,  satisfaction,  leadership  and  organi¬ 
zational  climate. 

^  4  b4  A  M  M  ^ 

During  this  block  of  instruction,  the  importance  of  proper  time  management 
skills  will  be  discussed.  Ways  of  better  utilizing  one’s  time,  money  and  other 
resources  will  be  looked  at. 
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^  lecture  covers  rational  approaches  to  goal  setting,  delegation,  the  five 
tus^-jph  dimefilons  to  work  satisfaction,  power  and  eaotional  factors  in  moti- 
.TSfclJng  others. 

Foaitlve  Motivation  Model 

This  lecture  will  take  a  look  at  the  Positive  Motivation  Model.  This  is  a  five 
step  model  that  will  introduce  participants  to  the  importance  of  expectations, 
skills,  feedback,  cocse<juences  and  growth. 

Problem  Solving  Exercise 

■HvIb  block  of  instruction  uses  the  "Desert  Survival"  exercise-  Participants 
are  given  a  scenario  and  told  to  rank  order  solutions  Individually  then  later 
as  a  group.  The  exercise  enables  participants  to  understand  the  basic  cotn- 
ponents  of  problem  solving  and  differences  between  working  as  an  individual  vs 
a  group. 

Tower  Building  Exercise 

This  activity  shows  how  well  the  group  plans,  delegates,  uses  resources,  com- 
ttonicates  and  works  together.  In  the  exercise,  each  group  Is  given  a  set  of 
tinker  toys  and  are  told  they  have  20  minutes  to  plan  and  practice  building  the 
tallest  freestanding  structure  possible.  However,  they  cannot  put  any  of  the 
pieces  together  during  the  20  minute  planning  phase;  instead  at  the  end  cf  this 
phase,  each  group  has  only  ^0  seconds  to  actually  build  the  structure. 

Verbal /Nonverble  Conamnlcatlon/Hostile  Groups 

This  block  ties  together  all  that  has  been  looked  at  the  past  two  days  of  the 
workshop  with  the  emphasis  on  coasBunicatlons.  In  addition,  looking  at  how  to 
manage  a  hostile  audience  cr  group  will  also  be  discussed. 

Stress  Management 

This  very  important  block  will  focus  on  the  importance  of  stress  management  in 
being  an  effective  officer.  Symptoms  and  causes  of  stress,  pctential  Issues 
and  concerns  with  stress  and  possible  consequences  of  stress  will  be  looked  at. 
In  addition  various  techniques  for  dealing  with  and  coping  with  stress  will  be 
presented. 

Introduction  to  Military  Portion 

This  will  begin  the  three  day  Air  Force  portion  of  the  LPDP.  It  will  consist 
of  administrative  policies  and  procedures  and  student  requirements,  followed  by 
the  welcome  by  the  Wing  Consnander.  The  purpose  and  background  of  the  program 
will  be  explained. 

Of  f  J  r««TAhio/Sf  andards 
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Key  elements  of  of f icership;  the  importance  of  officership  and  Air  Force  stan¬ 
dards  to  effective  leadership;  discussion  on  enforcing  standards  through  the 
use  of  exercises  will  be  used. 


^yaiuea/^cfiics 

iDiui^tng  this  block,  the  significance  of  hov  we  develop  our  value  system  and  how 
it.  relates  to  individuals  and  groups  will  be  discussed.  A  number  of  exercises 
on.  values /ethics  are  incorporated  as  well  as  a  PBS  video  an  ethics - 

Leadership 

Situational  leadership  is  the  focus  of  this  block  as  participants  analyze  this 
theory  using  the  film  "Twelve  O'clock  High.”  Also  used  is  another  film,  "A 
Leadership  Alliance"  by  Tom  Peters  to  Illustrate  different  leadership 
approaches  to  delegation. 

Military  Justice 

A  briefing  by  the  SJA  Introduces  professional  relationships  with  subordinates, 
peers,  and  supervisors.  Possible  consequences  of  ucprofesslonal  relationships 
are  discussed  as  It  relates  to  officershlp. 

Professional  Relationships 

This  phase  of  the  workshops  gives  the  particlpanta  an  opportunity  to  have  a 
personal  interview/discuaeion  with  senior  officers,  senior  NCO's  and  offlcerc 
from  the  joint  service.  A  question  and  answer  period,  conducted  in  an  informal 
forum  enables  discussion  of  their  views  of  officers,  professional  relatione  and 
any  topic  related  to  this  program. 

POH  Video 


Colonel  Henry  Fowler,  Air  Force  SJA,  talks  about  his  life  as  a  POW  for  almost 
six  years,  and  the  impact  of  leadership  in  a  POW  environment. 

End  of  Course  Critique 

LPDP  wrap  up  items  will  be  discussed  followed  by  an  end-of-course  student 
critique. 
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“Officership-  1  have  had  a  lot  of  fexperieace  in  the 
v7.i-i^iais;cahlp  and  ataijAgftiuent  area,  but  I  have  not  had  any  training  in  officership. 
7X7fjQU^  a^ter  the  exerclaes  and  discusalona  I  knew  what  it  was  but  I  hadn’t 
7 Id’eiUiifiAd  it  as  auch.  It  was  a  tresjeadous  experience  for  me."  Many  of  the  co«’- 
’gathered  from  the  end  of  course  critiques  echos  this  lieutenant's 
Tjthoughts.  It  appears  evident  that  the  importance  of  IWLE  is  very  relevant  to  the 
.  4jsv@l®p*gnt  of  our  futiure  Air  Force  officers  and  leaders.  The  Lieutenants 
’  "Ifrofeasioioal  Development  Program  is  Strategic  Air  Command '  s  attempt  at  pro- 
-vtdlmg  its  junior  officers  the  opportunity  to  ask  questions,  give  their  opi¬ 
nions,  make  decisions  and  develop  and  practice  th«lr  own  leadership  styles.  If 
.the  coaBMftnts  gsthered  thus  far  are  any  indication  of  the  success  of  the  LPDP, 
the  program  will  be  e  valuable  asset  to  the  Air  Force. 
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^  Arthur  Himder 

US  Air  Force  Academy 

Forty  elgtLt  Air  force  Acadeoy  cadets  were  used  to  exaoine  tfte 
effects  of  cooperative  vs  coopatitive  attitudes  and  reward  struc¬ 
tures  on  the  perforfliance  of  an  arcade- type  ccaputer  game.  Although 
aeither  factor  alone  influenced  perforsar.ee,  their  interaction  was 
found  to  he  vary  significant;  subjects  performed  pcoriy  when  the 
rsHsrd  structure  did  not  oaten  tnair  individual  orientation. 
Implications  for  military  training  programs  are  discussed. 


Morton  Deutach  (1949)  identified  two  types  of  situations  as  end  points 
on  a  cemtinuuffi  of  outcome  ralatioasnips.  Ra  defined  cooperative 
situations  as  those  in  which  the  goals  of  all  individuals  were  positively 
related  (i.c.,  the  success  of  any  member  of  a  group  made  the  auocess  of 
other  members  more  liKaly).  In  contraist,  competitive  situations  were 
defined  as  tnose  in  whicn  tns  success  of  one  member  made  tne  suceaas  of 
others  less  probable.  Deutscb  found  that  attitudes,  perception,  and 
performance  can  be  influenced  by  these  different  reward  structures. 
Since  Deutach,  educational,  social  and  industrial  psychologists  have 
Studied  the  effects  of  these  al terns tive  reward  structures  on  a  variety 
of  tasks  in  many  different  settings.  Althoogn  most  publisned  reports 
suggest  advantages  for  ooope:.ative  reward  structures  (Johnson  and 
Johnson,  1963 )<  many  institutions  continue  to  attempt  to  use  individual 
competition  to  Inoreaae  motivation  and  enhance  performance. 

Individuals  differ  in  their  preference  for  these  reward  structures  and 
these  preferences  affect  a  variety  of  outcomes  (Cohen,  1932).  Preferences 
reflect  underlying  belief  structures  and  values.  Those  “personal  episte¬ 
mologies"  CSC  be  more  important  predictors  of  parformsnea  and 
satisfaction  then  traditional  individual  difference  measures  such  as 
"speed"  or  "intelligence'  (Greeno,  1939).  Most  studies  of  individual 
differences  support  the  notice  that  cooperative  individuals  are  more 
likely  to  be  associated  with  higher  group  satisfaction. 

In  this  stixdy,  wa  sought  to  vary  tnese  two  factors  iniepeadently;  the 
reward  structure  and  individual  ettltudea  toward  these  structures.  The 
reward  structure  was  manipulated  to  create  either  competitive  or 
cooperative  interpersonal  relations  within  small  groups.  Baaed  on 
subjects'  responses  to  an  attitude  survey,  thsy  were  selectively  assigned 
to  create  groups  of  individuals  with  either  competitive  or  cooperative 
orientations.  Tne  primary  criterion  was  performance  on  a  demanding, 
arcade- type  computer  game  modified  to  require  coordinated  inputs  from  two 
subjects.  Specifically,  tnis  study  sought  to  identify  the  main  and 
interactive  effects  of  situational  and  individual  factors  on  performance 
and  satisfaction.  It  was  hypothesized  that  advantages  associated  witn 
cooperative  reward  structures  and  cooperative  individuals  suggested  by 
educational  and  industi’ial  reaearch  would  extend  to  this  complex 
interactive  task. 


.  Metnod 

Forty— eight  Treshhen  cadets  (forty-ono  male  and  aevan  female)  between 
the  ages  of  18  and  21  volunteered  to  participate  in  this  study.  Although 
subjects  did  not  receive  reaunaraticn ,  participation  in  this  experiment 
excused  them  from  two  hours  of  unpleasant  training  and  prizes  were 
offered  for  top  performers.  As  cadets,  our  subjects  were  part  of  a 
select  group  of  young  adults.  Cadets  average  SAT  score  is  1250,  73%  were 
in  tne  cop  10%  of  taeir  graduating  class,  and  80%  earned  one  or  more 
varsity  letters  in  high  school  athletics.  As  a  group,  cadets  display 
such  nooogsneity  on  many  measures  of  academic  and  athletic  achievement, 
they  are  a  peer  experimental  sample.  Their  distinctiveness  from  the 
general  population  and  restricted  range  are  both  problematic.  However, 
cadets  do  represent  many  young  adults  who  are  competitively  selected  for 
enxury  and  education  in  demanding  military  and  civilian  professions.  It 
is  ^30  true  that  despite  their  similarity  in  achievements,  there  is 
considerable  diversity  in  some  cadet  attitudes. 

A  10- item  attitudinal  survey  was  used  to  measure  subjects'  preferences 
for  cooperative  or  competitive  environments.  Subjects  were  required  to 
indicate  their  agreement  or  disagreement  with  each  of  10  statements  on  a 
6-point  scale.  Five  of  the  statements  reflected  individually  competitive 
orientations  (e.g.,  "I  prefer  individual  sports  to  team  sports”)  and  five 
atataments  reflected  cooperative  orientations  (e.g. ,  "I  taka  pride  in  the 
accompllahments  of  others”).  The  sum  of  a  subject's  responses  to  the 
five  competitive  statements  were  subtracted  from  the  sum  of  their 
responses  to  the  cooperative  statements.  The  difference  was  used  as  a 
measure  of  cooperative  orientation. 

The  Whale  Gome,  an  arcade- type  computer  game  was  the  criterion  task. 
Specially  developed  to  study  human  performance,  this  game  required 
subjects  to  guide  a  blue  wnale  to  accomplish  two  distinctly  different 
tasks:  eating  plankton  and  crashing  kayaks.  Plankton  eating  was  a 
tracking  task  which  required  subjects  to  guide  the  whale  to  a  randomly 
drifting  plankton  target.  This  task  was  simple  but  the  unpredictable 
movement  of  the  plankton  made  it  very  uncertain.  In  contrast,  kayak 
crashing  was  certain  but  complex.  Twenty-five  kayaks  appeared  at 
discrete  locations  on  the  screen  perimeter  az  predetermined  times 
throughout  t.he  game.  Once  on  screen,  the  kayaks  moved  one  space 
horizontally  end  vertically  toward  tne  whale.  This  pursuit  continued 
until  one  of  two  things  happened:  the  kayak  reached  the  whale  or  it 
crashed  into  one  of  twenty  Icebergs.  Subjects  lost  points  for  being 
harpooned  but  gained  points  if  the  kayaks  crashed.  Subjects  were  given 
explicit  priority  instructions  at  the  beglxmiag  of  each  game  telling  them 
Which  of  the  tasks  was  more  important  (i.e.,  worth  10  times  more  points). 

Groups  of  eight  subjects  completed  the  attitudinal  survey  and  received 
basic  instruction  on  the  Whale  Game  during  the  initial  one-heur  session. 
They  accomplished  8  practice  trials  (4  of  each  priority)  and  recorded 
their  scores  at  the  end  of  each  trial.  Subjects  wei*e  then  assigned  to 
eight  aix-peraon  groups  such  that  each  group's  average  performance  during 
ZTtS  iuitinl  scsalca  wna  equivalent.  Seven  ef  the  groups  coot-sin^d  one 
female  and  five  male  cadets  and  tlie  other  was  all  male.  No  group  had 
core  than  two  members  from  the  same  squadron.  Within  these  constraints, 
distinctly  competitive  or  cooperative  groups  were  created.  This 
treatment  was  designed  to  accentuate  the  effects  of  individual  attitudes. 


43 


Ttie  one-hour  expariaental  eession  took  place  approxicately .  six  weeks 
after  the  initial  training  sasaion.  The  seconO  independent  variable  in 
tnis  study  was  task  reward  structure.  Four  groups  received 

ocapetitive  instructions  and  the  otner  four  received  cooperative  instruc¬ 
tions.  A  conpetitive  reward  structure  was  iaposed  by  telling  tae  six 
subjects  in  a  particular  group  tnat  the  top  scorer  among  then  would  be 
invited  to  a  "pizza  party".  Althoiigh  most  college  freshmen  would  not  see 
this  reward  as  being  very  significant,  cur  subjects  were  quite  excited  by 
it.  The  same  reward  was  offered  to  the  cooperative  groups  but  the 
criterion  was  chans^ad.  The  cooperative  reward  structure  was  established 
by  telling  subjects  that  the  score  of  all  group  asabers  would  be  compared 
to  tne  scores  of  other  groups  end  the  group  with  the  coabined  top  score 
would  be  invited  together  to  the  pizza  party.  Thus  in  the  competitive 
groups,  tne  object  was  to  perform  better  than  the  other  members.  In  the 
cooperative  groups,  tne  goal  was  to  maximize  tne  performance  of  the  whole 
group. 

Two  types  of  dependent  measures  were  of  interest.  Task  perfomance 
was  measured  by  the  total  number  of  points  scored  on  the  two  game  tasks; 
eating  plankton  and  crashing  kayaks.  The  game  itself  was  identical  to 
the  one  subjects  practiced  duiring  tne  initial  session  but  the  way  it  was 
played  was  not.  The  six  subjects  in  each  group  shared  three  computers. 
For  each  trial,  one  subject  controlled  the  horizontal  movement  of  the 
whale  and  another  controlled  the  vertical  movement.  This  manipulation 
forced  subjects  to  interact  with  one  anotner  (as  would  an  aircrew). 
Subjects  rotated  ao  they  played  one  game  of  each  priority  with  each  of 
the  other  five  subjects.  Each  subject  controlled  horizontal  whale 
movement  during  five  trials  and  vertical  movement  on  the  otner  five. 
Both  subjects  shared  the  same  score  for  a  given  trial  but  the  rotation 
allowed  overall  individual  scores  to  vary  greatly.  At  the  end  of  the 
session,  subjects  were  asked  to  respond  to  five  questions  using  a  six 
point  Lickert  scale.  The  questions  concerned  their  general  satisfaction 
with  the  game  and  their  willingness  to  participate  in  future  experiments. 
The  average  rating  on  these  five  questions  was  used  as  a  measure  of  their 
satisfaction,  the  second  dependent  variable. 

Results 

Results  from  tne  attitudlnal  questions  showed  that  our  subjects  tended 
to  endorse  the  cooperative  statements  al.igntly  more  strongly  than  the 
competitive  ones.  The  mean  was  2.52  (u=4»27)  and  individual  scores 

ranged  from  -6  to  11.  The  distribution  appeared  to  be  normal. 

Although  data  could  have  been  partitioned  to  examine  tne  effects  of 
practice  or  differences  in  the  two  subtasks,  the  power  of  this  design 
only  supported  using  a  single  aggregate  measure  of  performance  for  each 
subject.  Multiple  regression  analysis  was  used  to  identify  the  effects 
of  attitudes  and  reward  structure  on  this  single  measure  of  overall 
performance.  In  tne  first  step  of  the  analysis,  both  attitude  and  reward 
structure  were  entered  into  the  regression  equation.  The  main  effects  of 
these  two  variables  "Tniained  less  than  1  .0  IS  of  the  total  variance  xh 
pei'formance .  However,  wnen  the  interaction  (reflected  by  tne  product  of 
tne  two  variables)  was  entered,  the  portion  of  the  variance  explained 
(r*-)  increased  to  20.7  %.  The  beta  regression  equation  listed  below  was 
signi-ficaut  at  the  .05  level  (F{3 ,44)‘^5 .319)  • 

Score  =  -.56  Attitude  -.23  Rewards  ■^.71  Interaction 
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individuals  were  aior*  aatiafiad  and  willing  to  participate  In  future 
experiaenta.  This  result  ia  not  too  eurprlaing;  what  is  surprising  is 
the  lack  of  significant  relationsnips  between  satisfaction  and  reward 
structure  (r».058),  the  reward  structure  interaction  Cr».150)  end  even 
task  perfodDsaoe  (r>.04O. 

Briefly,  these  results  suggest  perforoasce  was  better  when  the  reward 
structure  ostened  the  individual's  orientation.  This  effect  appeared  to 
be  particularly  detrisental  to  those  individuals  with  strong  attitudes 
who  found  tbeaselves  under  "Inappropriate”  reward  structures.  Those  with 
aoderate  attitudes  appeared  to  be  able  to  perfora  well  in  either 
environment.  Satisfaction  was  unaffected  by  performance  or  reward 
structure  but  was  generally  higher  among  those  who  expressed  a  preference 
for  cooperation. 

Discussion 


IHEIVIDUAI.  OKlClinTlCII 


The  expected  direct  advantages  of  cooperative  attitudes  and  reward 
structures  -’ere  not  found.  However,  tna  pattern  of  results  still 
provides  ini  "esting  insignta  into  the  dynamics  which  may  underlie  other 
successful  u;.  .onstrations  of  the  benefits  of  cooperation. 

Earlier  the  issuw-  was  raised  that  Air  Force  Academy  cadets  differ 
soasewhet  fros  other  college  freshmen.  One  difference  ia  the  high  level 
and  variety  of  their  high  school  achievements.  If  one  assumes  that  a 
coffipetltive  attitude  is  positively  associated  with  the  academic,  athletic 
and  extracurricular  acnleveaents  used  for  selection,  our  sample  may  have 
been  more  competitive  than  subjects  in  otner  studies  of  cooperative 
effects.  If  only  those  subjects  witn  relatively  cooperative  attitudes 
are  considered,  there  appears  to  be  clear  support  for  the  proposition 
that  cooperative  reward  otruccuras  increase  performance. 


Althou^n  atteap-cs  were  oade  zo  employ  an  erperiaental  task  wtiicfl  was 
more  eoologically  valid,  tne  duration  of  the  experiment  was  still  less 
than  one  hour-  Host  studies  which  have  successfully  demonstrated  the 
advantages  of  cooperation  nave  involved  weeks,  months  or  even  years. 
Might  we  expect  advantages  to  accrue  to  the  cooperative  groups  if  this 
experiment  were  extended?  Cooperative  individiials  were  more  satisfied 
and  also  aora  willing  to  participate  in  future  experiments  regardless  of 
the  reward  structure  or  level  of  performance.  To  the  extent  this 
increased  motivation  result  in  greater  persistence  and  more  rapid  still 
acquisition,  the  cooperative  subjects  anould  continue  to  improve  in 
comparison  to  their  less  satisfied  competitive  peers.  Additionally,  it 
mignt  be  expected  tnat  positive  relationships  and  social  support  systems 
would  be  more  likely  to  develop  among  the  cooperative  groups. 

The  implications  of  these  results  for  military  training  programs  are 
considerable.  Many  training  programs  rely  heavily  on  interpersonal 
compstition  as  a  mechanism  for  increasing  trainees'  motivation  and  hence 
performance.  Our  results  suggest  that  tne  short  term  effect  of  such  a 
policy  on  performance  is  nil.  Emphasis  on  competition  will  enhance  the 
performance  of  some  traJ.naea  but  inhibit  the  performance  of  others.  This 
begs  the  quaation  of  which  trainees  are  helped  and  which  are  hindered  by 
sucn  a  policy.  Ideally,  those  who  are  most  likely  to  become  competent 
and  dedicated  memoera  of  operational  units  ere  those  whose  performance 
would  be  facilitated.  However,  just  the  opposite  result  occurs  if 
competitive  reward  struoturaa  are  employed  to  train  individuals  for 
operational  environments  in  wnich  teamwork  and  cooperation  ere  required. 
Competitive  reward  structures  benefit  competitive  individuals. 
Competitive  individiials,  especially  those  with  pronounced  biases,  are 
likely  to  perform  poorly  in  cooperative  environments.  Additionally, 
competitive  individuals  seem  less  likely  to  be  satisfied  regardless  of 
tneir  level  of  performance  or  the  type  of  reward  structure.  rrom  this 
perspective,  part  of  the  answer  to  the  question  "Where  have  all  our 
pilots  gone?"  becomes  distressingly  clear. 
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Aptitude  Battery  and  Personal  Type  Inventory 
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Abstract 

This  paper  describes  the  development  and  use  of  a  new 
Personal  Type  Inventory  and  Military  Career  Opticas  listings  for 
counseling  and  placing  military  entrants.  Methods  and  advantages 
for  their  use  in  assisting  enlisted  (in  conjunction  with  aSVAB 
scores)  and  officer  personnel  in  choosing  military  careers  are 
presented . 

Career  and  occupational  psychologists  have  been  familiar  for  years 
with  Holland's  (1985)  personality  typology.  Briefly  he  proposes  that 
there  are  six  primary  personality  types  (Realistic.  Investigative, 
Artistic.  Social.  Enterprising,  and  Conventional).  and  the  individual 
with  a  certain  personality  type  tends  to  seek  out  and  interact  “best” 
with  a  matching  environment.  His  current  work  is  focused  on  the  Self 
Directed  Search  (1985)  (SDS) ,  in  which  the  respondent  indicates  their 
competencies,  activity  and  occupational  preferences,  and  estimated 
abilities.  These  responses  are  S'umnarized  as  a  three  letter 
occupational  code.  An  occupational  classification  booklet  is  provided 
to  locate  suitable  work  environments  that  match  this  code. 

Several  years  ago  this  writer  began  to  wonder  why  Holland  had  not 
yet  developed  a  more  generalized  personality  instrument  to  define  his 
typology,  since  he  lists  a  variety  of  personality  descriptions  for  each 
of  the  six  types  (SDS  Professional  Manual.  1985).  It  was  decided  to 
attempt  to  develop  a  Personal  Type  Inventory  (PTI)  using  similar 
descriptors  to  determine  what  more  generalized  personality  (as  opposed 
to  vocational)  typology  might  emerge.  In  reviewing  Holland's  lists,  two 
general  handicaps  to  their  use  in  a  self -deccriptive  inventory  became 
obvious.  The  first  is  that  the  same  descriptor  is  frequently  used  for 
more  than  one  type  (e.g..  sociable  describes  both  the  Social  and 
Enterprising  types).  Secondly,  a  variety  of  negative  descriptors  (e.g. 
asocial,  pessimistic,  disorderly,  domineering,  and  unimaginative)  are 
contained  in  his  lists. 


PTI  Developnient 


Briefly,  the  approach  to  developing  appropriate  items  was  to 
eliminate  all  overlapping  and  less  socially  desirable  descriptors 
suggested  by  Holland,  and  generate  lists  of  semantically  equivalent 
descriptors  for  each  type.  The  item  format  chosen  was  paired  -  comparison 
with  each  word  of  a  pair  representing  one  of  Holland's  six  types, 
ilclland  proposed  that  the  six  types  form  a  hexagonal  model  (in  two- 
dimensional  space)  with  more  closely  related  types  adjacent  to  each 
other  and  less  closely  related  types  opposite  each  other. 


It  rtppeari’d  Icgicai  fron  this  Kodfci  to  pair  descriptors  that 
represef^td  non-adjacent  types,  A  second  criteria  used  was  to  pair 
descriptors  from  the  most  infrequently  occurring  two  letter  Holland 
typology  codes.  For  example,  the  fewest  members  of  any  sample  receive 
an  Artistic  -  Conventional .  or  Conventional -Artistic  classification  on  the 
SDS .  A  primary  reason  for  using  these  criteria  and  the  paired- 
comparison  item  format  is  that  it  forces  a  higher  degree  cf  consistency 
of  response  in  the  individual  and  increases  the  differentiation  of  the 
type  scores. 

After  various  item  try-outs.  90  paired -comparison  iteras  were 
developed  that  can  be  scored  for  six  scales  which  parallel  Holland’s 
themes  ;  Practical  (P)  .  Reflective  (B.)  .  Imaginative  (I).  Supportive 
(S) ,  Extroverted  (E) .  and  Disciplined  (D) .  The  names  of  the  scales  were 
determined  from  their  general  item  content  and  a  factor  analysis  of  the 
responses  of  376  male  and  female  subjects.  Three  bi-poiar  factors 
emerged  from  a  Karris  image  analysis  oblique  solution.  Significant 
factor  loadings  were  found  for  the  following  scales;  E  vs  .  R  and  P,  S 
vs.  1  and  D.  and  1  vs .  D  and  R.  These  analy.ses  also  suggest  a  three 
dimensional  model  rather  than  the  two  dimensional  hexagonal  model  as 
proposed  by  Holland  (1985).  Other  correlational  and  factor  analyses 
indicate  that  the  scales  are  also  gander-free.  Their  test-retest 
reliabilities  range  from  .82  to  .90.  which  compares  favorably  with  other 
similar  personality  and  interest  inventories. 

The  PTI  has  now  been  administered  to  over  500  college  level 
students.  Concurrent  validity  stud.ies  indicate  that  the  PTI  will 
classify  .students  by  college  major  with  approximately  the  same  relative 
efficiencies  as  Holland's  SDS  and  similar  instruments.  The  primary 
advantage  for  the  PTI  is  the  15  to  30  minutes  required  for 
administration  and  self -scoring.  Field  trials  with  junior  high  and  high 
school  students  are  currently  underway.  A  Spanish  language  form  has 
been  developed  and  field-tested  with  employed  subjects  in  the 
Guadalajara,  Mexico  area. 

Occupations  Lists  Development 

In  order  to  provide  career  exploration  information,  a  PTI 
Occupations  List  was  developed  to  classify  approximately  50C  occupations 
(90‘A-95%  of  those  in  the  U.S.  labor  market)  using  two  letter  PTI  codes 
(e.g.,  Practical-Reflective).  The  assignment  of  two  letter  codes  to 
occupations  was  determined  by  utilizing  a  combination  of  two  well 
researched  systems.  The  primary  system  was  the  12  interest  based 
categories  used  in  the  Guide  for  Occupational  Exploration  (1979),  This 
was  combined  with  the  orientations  of  occupat.icns  to  Data,  People, 
Things  and  Ideas  framework  utilized  in  the  development  of  the  Dictionary 
ct  Occupational  Titles  (1977)  occupational  codes. 

At  the  same  time  Military  Career  Options  (MCO)  listings  were 
developed  to  relate  PTI  two-letter  codes  to  the  13A  enlisted  and  71 
officer  occupations  contained  in  the  1966-89  Military  Career  Guide 
(1983).  For  enlisted  occupations,  the  major  categorization  is  by  the 
four  .^rmed  Forces  Vocational  Aptitude  Battery,  Form  lA  (ASVAB.  1984) 
Occupational  Groups:  (1)  Mechanical  and  Crafts;  (2)  Business  and 
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{-Si  .‘.-v;.,  -CXerical;  (3)  Electronics  and  Electrical:  and  (4)  Health,  Social,  and 
Technology,  The  enlisted  occupations  arc  sub-categorized  by  PTI  two- 
letter  codes  under  each  of  these  Occupational  Groups.  This  list  also 
indicates  the  ASVAB  Form  14  "SO-SO**  score  (representing  the  50  percent 
probability  of  qualifying  for  training)  for  each  enlisted  occupation. 
The  71  Officer  occupations  were  classified  by  two  letter  PTI  codes.  A 
-partial  listing  for  the  MCG  enlisted  category  of  Business  and  C.l.eric3l 
is  illustrated  below. 


Business  and  Clerical 


PTI .Code 

SO*  SO 

Lodging  Specialists 

26 

Postal  Specialists 

29 

Transportation  Specialists 

24 

Administrative  Support  Specialists 

28 

Personnel  Specialists 

30 

Religious  Program  Specialists 

29 

Administration  and  Use 

The  procedure  for  using  this  system  with  enlisted  or  officer 
applicants  is  to  administer  the  PTI.  and  then  search  for  occupations 
matching  combinations  of  the  obtained  three  highest  score  code  letters 
in  the  MCO  lists.  Analysis  of  highest  through  lowest  obtained  PTI 
scores  for  376  subjects  indicates  that  only  a  letter  representing  a 
score  of  17  or  above  should  be  used  as  the  first  letter  in  a  code. 
Similarly,  only  letters  representing  a  score  of  15  or  above  should  be 
used  as  a  second  letter  in  a  code.  Approximately  two  thirds  of 
examinees  will  have  three  scores  of  15  or  above,  and  thus  would  have  six 
two  letter  code  combinations  to  apply  in  the  MCO  lists.  Only  about  two 
percent  would  be  limited  to  oue  PTI  code  using  these  rules. 


To  find  passible  enlisted  career  options  in  the  MCO,  one  would 
first  look  for  matching  PTI  code  occupations  under  the  occupational 
group  representing  their  highest  ASVAB  score  (e.g..  Business  and 


Clerical) 


If  none  of  their  PT! 


combinations  appear  there,  they 


would  move  on  to  their  next  highest  ASVAB  occupational  group  score  and 
repeat  the  search.  Although  military  occupations  have  limited  variety 
compared  with  the  civilian  labor  market,  all  six  major  PTI  types  are 
represented  in  both  the  enlisted  and  officers  occupational  lists. 
However,  enlisted  military  occupations  are  heavily  concentrated  in  those 
areas  associated  with  Practical.  Reflective,  and  Disciplined  types 
(approximately  75  percent) .  This  is  less  true  of  officer  occupations 
whare  a  more  managerial  orientatron  (Extroverted  type)  ic  alee  present 
in  many  type  codes.  After  a  short  list  of  appropriate  occupations  has 
been  developed,  the  individual  may  be  referred  to  the  Military  Career 
Guide  (1988)  for  a  description  of  the  characteristics  and  requirements 
of  those  specialties . 
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Practical  Advantages 


The  use  of  the  FTI  with  military  entrants  (particularly  in 
combination  with  ASVAB  scores  for  enlisted  personnel)  provides  several 
practical  advantages  in  military  career  selection.  The  PTI  is  self- 
scoring  and  requires  15  to  30  minutes  to  complete.  It  may  also  be 
utilized  in  individual  or  group  situations.  For  enlisted  examinees  it 
can  be  administered  at  tne  same  tine  as  the  ASVAB  or  independently. 
Extensive  training  is  not  needed  in  administration  of  these  instruments, 
since  the  directions  for  using  the  PTI  and  MCO  are  self-explanatory. 
However  the  examinee  will  obviously  need  the  same  guidance  in  using 
informational  sources  about  military  careers  as  is  needed  for  counseling 
related  to  ASVAB  scores. 

The  PTI  may  also  be  useful  as  an  adjunct  to  (or  perhaps  suitable 
substitute  for)  the  Exploring  Careers  (1986)  workbook.  Used  in 
conjunction  with  the  workbook,  the  three  highest  PTI  scores  could 
provide  supplementary  data  for  determining  the  individual's  three  most 
relevant  areas  of  interests  and  skills.  For  example,  a  high  score  on 
the  PTI  Supportive  scale  would  suggest  the  selection  of  Work  With  People 
as  a  high  interest  and  skill  area  in  the  Exploring  Careers  exercises. 

The  PTI  scores  and  MCO  officer  list  would  also  appear  to  be  a  most 
efficient  method  for  making  career  choices  among  ROTC .  CCS.  and  military 
academy  students.  The  writer's  experience  as  a  professional  counselor 
and  farmer  Air  Force  Academy  and  AFROTC  Liaison  Officer  suggest  such  a 
system  would  be  quite  helpful  in  counseling  applicants.  Similarly,  it 
could  be  used  in  the  final  year  of  military  academy  or  ROTC  training  to 
provide  guidance  in  selecting  military  careers. 
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■THE  EFFECTO”  '’COSMETIC’-  DESIGN  VARIATION  ON 
PERCEIVED  VEHICLE  SAFETY 

Dennis  B.  Beringer 
New  Mexico  State  University 

Abstract 

Vehicle  systems  come  in  a  variety  of  shapes  and  sizes.  Some  of  the  noticeable 
external  variations  are  direct  reflections  of  structural  differences  white  others 
are  more  ’Cosmetic  in  nature.  It  was  hypothesized  that  judgements  of  vehicle 
s^ety,  although  often  a  function  of  structural  design  and  operator  personal 
experience,  may  be  Influenced  by  essentially  cosmetic  external  variations  in 
de^gn  that  do  not  represent  salient  differences  in  vehicle  structure.  Individuals 
were  asked  to  rate  the  general  and  specific  sa/eiy  characteristics  of  automobiles 
from  viewing  a  series  of  photographs  of  each  of  several  body  styles.  Although  the 
general  rank  onierlng  placing  sedaiK  and  station  wagons  safest  wite  converUbtes 
least  safe  was  expected,  models  that  were  struciurally  equivalent  were  rated 
difier&ntly  depending  upon  wheteer  a  removable  roof  panel  was  installed  or 
rmioved.  Titus  it  was  determined  teat  some  removaUe  sections  or  accessones  may 
actuaHy  decrease  the  operator's  perception  of  tee  hazard  present  although  the 
actual  hazard  may  not  have  been  ttecreas^ 


Examination  of  contemporary  vehicle  systems,  be  they  designed  to  traverse  the  ground,  cross 
tee  water  or  fly  through  the  air,  reveals  a  tremendous  diversity  of  designs,  in  some  cases  the 
variations  that  one  finds  witNn  a  specific  category  of  vehitie  are  a  direct  furx:tiort  of  variations 
in  the  task  to  be  performed.  If  one  examines  the  staicture  of  a  motorcycle,  for  example,  in 
comparison  with  a  picK-i^  truck,  these  two  vehicles  are  dearly  designed  to  perform  different 
tasks.  A  b^>roduct  of  the  cSfferences  is  the  endosing  of  the  operator  in  the  tnjck,  providing 
some  buffer  between  tee  operator  arto  the  elwiems,  be  they  weather  or  other  vehicles.  Thus  one 
would  expect  some  dfference  in  the  rating  at  vehicie  safety  based  upon  the  presence/absence  of 
operator  containment  (and  the  stability  of  the  vehicle;  number  of  wheels,  center  of  gravity, 
etc.). 

A  rather  unique  situation  develops  when  a  single  system  may  take  on  several  configi^atlons. 
This  is  particularly  interesting  when  changes  between  configurations  do  not  materially  affect 
the  structural  integrity  of  the  system  but  may  alter  the  exterior  appearance.  One  primary 
example  of  this  type  of  system  is  the  case  o1  vehicles  havteg  remov^le  roof  sectiorts.  in  some  of 
these  vehides  one  may  interchange  dlfterent  types  of  roof  sections  (tinted  glass,  fibergias)  or 
cerate  the  vehide  witfiout  any  such  sections  in  pl^oe.  This  variation  in  configuration  may  play 
a  rote  in  toe  relative  rating  of  vehicle  safety  so  obtained,  particularly  if  the  rating  is  largely 
determined  with  contaIrMTient/retention  of  the  operator  in  an  accident  or  rollover  as  a  major 
factor. 

The  question  of  how  these  perceptions  of  hazard  miglit  vary  arose  recently  in  litigation. 
Misperceptions  in  automotive  operations  have  been  examined  in  several  cases  (Vernoy  and 
Tomeriin,  1989;  Mac  Gregor  and  Slovic,  1989)  as  has  risk  taking  and  accidents  (Taylcr, 

1976).  It  is  generally  accepted  that  an  accurate  perception  of  a  hazard  is  necessary  as  part  of 
the  process  or  avoiorng  an  accident  (Smith  and  beringer,  lyti/').  A  case  had  been  identitied 
where  perception  of  hazard  might  not  be  accurate  for  part  of  the  user  population. 


I 


■'  in  particular,  an  automobiie  was  identified  (Chevrolet  Corvette  )  that  couJd  take  several 

. '  ebnllguratioftsi  ttW  T4op  design  allcwed  one  to  configure  ttw  v^icle  as  either  a  pseudo  hard  top 

(ptexfglas  panels),  sun  roof  (firited  glass  panels),  or  pseudo  convertible  (panels  removed), 
ihe  T>top  C(»digitfatk)n  consists  of  two  parwis,  one  on  either  side  of  the  veWde  centerline.  The 
two  panels  are  separated  by  a  central  rib.  Ramoval  of  the  panels  creates  two  rectangular 
openings,  one  above  the  driver  and  one  above  tiie  passenger.  It  was  generally  believed  that 
teufivlt^ais  were  llkeiy  to  perceive  the  conflgurattons  with  Instafied  panels  as  slightly  safer 
than  that  wtth  the  panels  removed  due  to  the  perception  that  toe  panels  provided  some  measure 
containment  for  the  operator.  In  most  cases  tote  would  be  true  given  that  the  panels, 
partlculariy  those  made  of  fiberglas,  had  a  positive  retention  system  that  prevented  the  panels 
frcmt  being  released  or  caused  the  panels  to  become  an  integral  part  of  the  structure  when 
fi^tenad  in  place.  This  partlciiar  system,  however,  was  found  to  release  the  pan^  under 
cerferin  conditions  In  a  roH-over  atcddent.  In  one  particular  case  a  panel  was  determined  to  have 
been  released  durirtg  toe  first  roll  in  such  an  accident. 

The  result  in  this  particular  case  was  that  the  probJtolHty  of  being  ejected  through  the  roof 
in  equivalent  accidents  would  not  be  materially  affected  by  the  presence  or  abswice  of  the  roof 
panels  because  they  woidd  be  likely  to  be  ml^ng  eariy  in  the  progress  of  the  accident.  Thus  an 
unw^ranted  differential  percejSlon  of  hazard  as  a  fufKrtlon  of  the  presence/absence  of  roof 
panete  might  be  a  factor  In  determining  whether  the  operator  was  likely  to  wear  a  seat  belt 
(prior  to  mandatory  seat  belt  useage  laws).  Whfle  risk  t^dng  as  function  of  seat  belt  i^eage  has 
been  Investigated  (Evans,  Wa^elewskl,  and  von  Busek,  1982),  no  study  appeared  to  have 
examined  the  reverse  where  vehicle  design  was  examined  as  the  causal  fador  in  seat  belt  useage. 
A  pictorial  survey  was  tinjs  constructed  to  examine  the  perceptlore  of  potential  operators 
(drivers)  of  this  systsni  as  well  as  other  automotive  systems  likely  to  be  encountered  by  the 
user  population. 


Method 


SlLmull 

A  series  of  phoiograftos  was  prepared  that  represented  a  wide  variety  of  automobile  styles. 
These  tochided  toe  followlr^  models:  Jetta  convertible,  Datsun  280Z,  Camaro,  Cutlass  Salon, 
compact  Chevrolet  station  wagon,  and  Chevrolet  Corvette.  The  convertible  was  photographed 
both  with  the  top  up  and  toe  top  down.  The  Corvette  was  photographed  with  fiberglas  panels  in 
f^ace,  tinted  glses  panete  in  place,  and  panels  removed.  AJl  of  the  photographed  automobiles 
were  wrtte.  Each  of  the  automobiles  was  photcgraphod  from  the  driver's  side  at  three  cfistances; 
far  with  the  automobile  filling  approximately  60<;-;,  of  the  frame  width,  intermediate  with  the 
automobUe  flHing  the  width  of  the  frame,  and  near  wtth  toe  automobile  extending  beyond  the 
width  of  the  frame.  The  latter  was  intended  to  provide  a  detailed  view  of  the  driver's  side  as  It 
would  be  seen  upon  approach  to  the  automobtte  as  though  one  was  about  to  enter  It.  DetaiBs  of  the 
rooffine  were  thus  visible  In  this  close  view. 

Procedures 

Sitojects  were  students  in  introductory  psychology  and  were  measured  in  a  group  setting. 

The  experimenters  were  allowed  to  show  the  dass  35mm  slides  of  the  automobiles  at  the  end  of  a 
class  session.  Each  person  was  given  a  questionaire  form  to  fill  out  during  the  viewing  of  the 

(tliriac  Tho  nhrvirmranhc  u/Arp  fihnwn  in  th«  orrlnr  nf  far  In  near  aS  thouflh  one  was  walkino 

-  . . . ^ 

toward  the  vehicle.  Each  slide  was  shown  for  approximately  5  seconds  with  a  longer  pause 
between  vehicle  types  (sets  of  three  photos).  Subjects  rated  each  vehicle  at  each  portrayed 
dtetarKe  using  the  provided  questionaire. 
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‘Questionaira.  The  rating  form  used  had  toiK  parts.  Part  I  was  titled  "General  Safety  RaHng; 
Hew  sal©  do  you  tWnk  is  each  of  the  foll<wing  cars?"  One  scale  was  used  for  each  of  the  nine  (9) 
CQoi^iDRS  all  rAw  scales  appeailr^  on  one  page.  The  seven  rating  categories  were  labei^ 
as  licdfows  from  left  to  r^;  very  unsafe,  moderately  unsafe,  sllghUy  unsafe,  average,  slightly 
safe,  moderately  safe,  very  safe.  Subejcts  were  to  mark  an  "A”  on  the  scale  for  Uw  far  view,  a 
"B"  for  the  interaiedtate  vlw,  and  a  “C"  for  the  near  view.  The  second  page  of  the  form  was 
ladbefed,  *iJ<e}9ipod  of  ifUURY;  How  tikeiy  do  you  think  it  is  that  a  person  could  be  seriously 
in|wed  in  tt^  car?"  The  same  number  and  type  of  scales  w^e  again  used  but  the  labels  ware 
altered  to  read:  very  unlikely,  moderately  unlikely,  siighfty  urtHkely,  unsure,  slightly  likely, 
rnoderatsly  likely,  very  Ukeiy. 

The  thkd  page  of  the  form  was  titled,  "Uk^lhood  of  BEING  THROWN  from  CAR:  How  Ck^y  do 
you  think  it  is  th^  a  p^son  could  be  thrown  from  ftds  car  in  a  rollover?"  The  same  scales, 
although  );%3ically  smaller  versbns,  were  used  for  responses  arvl  two  crriurrms  of  tfmse  scales 
were  used;  one  frx  "wearkig  a  seat  bett"  and  one  for  "NOT  wearing  a  seat  belt”.  It  ^XKjid  be  noted 
dial  the  entire  set  of  slides  was  shown  for  each  ftie  que^lonaire  pages.  Thus  when  flHing  out 
this  third  page  subjects  had  already  seen  each  of  the  stimuli  twice  and  were  viewing  eac^  a  third 
time.  A  fourth  pa^  was  used  to  assess  whether  the  individuai  felt  it  desireable  or  undeslrabie  to 
be  Qwown  from  a  car  during  an  acddwt,  subject  age,  gender,  seat  belt  use,  and  whether  each 
was  or  was  not  a  licer^sed  driver  (experience,  expostae).  Scoring  vras  accomplished  by 
asslgr^  the  numbers  1  through  7  to  the  seven  scale  categories. 

Resalts 


fiflOflttal.SatgtyRafeig 

The  genersU  ordering  obtained  was  expected,  placing  the  automobile  types  in  the  foHowing 
from  rated  most  safe  to  rated  least  safe:  station  wagon,  Oamaro,  Cutlass  Salon,  280Z,  Corvette 
(glass),  delta  (top  up),  Corvette  (fiberglas),  Corvette  (open),  and  Jetta  (top  down).  An 
interaction  of  bixiy  s^e  and  viewing  distarK^e  emerged,  with  Ore  Cutlass  and  Camaro  exchangirrg 
ranks  as  the  statton  wagon  and  cutlass  increased  in  rated  safety  while  others  deaeased  in  rated 
safety  as  viewing  rSstance  decreased.  This  results,  depicted  in  Fij^re  1 .  Is  imdoidftediy  due  to 
Ore  relative  size  of  the  cars  becomirrg  nrore  evident  as  view  distance  was  decreased  and  roof  line 
features,  etc.,  becoming  more  tfscernable  (sun  roof  openings  in  particuiar).  The  interesting 
difierence  was  Ore  general  ranking  of  Ore  open  Corvette  as  more  hazardous  than  the  same 
automobBe  with  either  glass  or  fiberglas  panels  in  place. 

P.efcetved  Uketihood  of  Election 

Although  the  ordering  of  v^^es  was  essentially  the  same  as  before,  the  seat-beft  variable 
was  responsible  for  a  shift  of  approximately  two  categories  on  the  scale  when  Ukelihood  of 
ejection  In  a  rollover  accident  was  rated.  On  the  top  end  of  Ifte  distribution  the  Jetta  cortvertibie 
(open)  moved  from  a  4.65  (slightfy  likely)  with  a  belt  to  6.55  (very  likely)  without  a  belt. 
The  station  wagon,  at  the  other  extreme,  moved  from  1 .6  (moderately  to  slightly  unlikely)  wKh 
seatbelt  to  3.85  (slightly  likely)  without. 

The  condltiorrs  of  Interest  were  those  involving  the  Corvette  configurations,  j  Mean  ratings 
for  these  three  forms  of  the  same  automotive  system  were  all  wiihin  0.6  points  in  the  belted 
condition:  fiberglas,  2.94:  glass,  3.23;  open.  3.56  (t  t  very  unlikely.  7  =  very  likely).  In 
the  no-belt  condition,  however,  the  separation  increased:  fiberglas,  5.06;  glass,  5.31;  open, 
6.22.  A  Friedman  analysis  of  variartcs  by  ranks  indicated  a  significant  difierence  across  these 

rali.ngs  (Xr^(2)  =  8.453,  £<.025;  when  corrected  for  ties,  Xr^>'l‘^  Cj-  Comparison  of  the 
glass  and  open  configuratiorts  using  the  Friedman  tost  indicated  near  significance  (tabled  value 


vaSuB  was  3.78).  The  cfifferancs  between  the  open  lop  and 
?^^cJiis*-pa0ef  coj^^  was  significant  as  tndlcaled  by  the  earlier  test  This  these 

we^e  rat^  as  <lit^enl  In  terms  of  rollover  ejection  hazard  though  the  actua* 
■  was  tikely  idenllcal.  It  should  also  be  tx>ted  that  the  ratings  of  possible  serious 

.  r^pe^y  foUpwed  the  ratings  ol  potottiai  ejectiw  from  the  veNcIe. 


FAR  meRMEDUTC  OOSE 


DISTANCE 


Figure  1.  General  safety  ratings  by  vehicle  type  and  distance. 


Dlscusdon  and  Cortciueions 

It  is  apparent  that  the  percepfion  of  hazard  In  Ihte  sHuatlon  was  rwl  equivalent  to  fire  true 
physical  hazard  as  embodied  in  the  design.  This  is  undoii>to<3y  due  In  large  part  to  the  general 
expectation  that  parts  of  a  system  that  appear  Integral  or  well  attached  wfH  remain  so  In  an 
accident.  TWs  Is,  of  cowse,  a  tenuous  assianptton  at  best  given  engineerirjg  considerations  and 
the  forces  gerierated  In  many  automotive  accidents.  The  solution  may  be  one  of  simply  Informing 
the  system  user  of  the  potential  hasard  in  a  salient  way.  One  canned,  however,  even  begin  such  a 
disetssion  without  Immediately  stumbUng  upon  the  effectiverress  of  warning  systems,  signs, 
tabets,  instructions,  and  the  like.  Orw  has  die  choice,  then,  of  either  engineering  systems  to 
meet  expectations  or  changing  expectations  to  coincide  with  actual  system  performance 
fimitatlons.  Once  again  it  appears,  as  always,  that  there  are  no  sim^  solutloos.  This  Issue 
may  become  a  factor  in  military  systems  where  modular  designs  create  an  appearance  of  unity 
in  a  system  but  where,  ki  fact,  the  system  may  come  apart  as  a  result  of  accidents,  hostile 
action,  etc.  The  likelihood  is  much  lower,  however,  for  mllHary  systems  than  for  coriiparable 
consumer  products  not  designed  for  survival  In  high-stress  environments. 
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Abstract 

Hanufacturing  military  uniforms  is  a  labor  inteaaiva  process 
requiring  complex  perceptual  end  motor  skills  and  repetitive  manual 
operations.  The  purpose  of  this  research  was  to  iicprovc  sewing 
operators’  efficiency  end  productivity  by  identifying  and  addressing 
husaan  factors  problems  in  job  and  workplace  design,  the  workplace 
envirosmant,  and  training. 

Apparal  toanuf&cturing  is  a  labor-intensive  process  requiring  20  or  more 
distinct  steps  for  the  cocapletion  of  a  garment.  Each  of  these  steps  involves 
the  operation  of  one  or  xoora  kinds  of  power  equipment  such  as  specialized 
cutting  and  sewing  machines .  The  steps  require  sign  ^Icent  amounts  of  manual 
manipulation  as  fabric  bundlas.  Individual  places,  end  unfinished  gerasnts  are 
transported,  inserted  into,  end  guided  through  the  machines.  These  operations 
are  highly  repetitive  end  vleuelly  demanding.  Heny  of  the  jobs  Ixnrolve 
complex  psychotootor  skills  that  reqtxlre  three  to  four  monthe  of  training  and 
practice  to  achieve  acceptable  porfozmaiuie  levels.  Wages  are  typically  on  a 
piecerate  basis.  While  the  introduction  of  high-technology,  aemi-autooieted 
equipment  to  the  manufacturing  floor  can  help  to  amaliorate  some  of  the 
problems,  it  will  create  new  difficulties  while  changing  the  basic  nature  of 
moet  jobs  very  little. 

The  purpose  of  this  progrem  was  to  explore  human  factors  problezas  lu 
typical  plants  msnufecturing  military  uniform  trousers  or  similar  trousers  and 
to  recoamend  cost-affective  interventions  for  the  identified  problems. 
Subsequent  work  was  planned  to  nest  raeomcwnded  solutions  in  conventional 
manufacti-'lng  environmente  and  to  project  and  address  human  factors  issues  in 
the  advanccu  technology  uniform  manufacturing  plant  of  the  future. 

Inadequate  job  design  and  badly  designed  workplaces  can  create 
tfiueculoakeletal  discoofort  or  disorders  in  assembly  workers  due  to  awkward 
working  postures,  excessive  reaches,  excessive  manual  t&anipulation,  excessive 
strength  cr  endurance  requirements,  or  coobinations  of  these  factors. 
Eepetitive  work,  for  example,  may  result  in  health  problems  such  as  cumulative 
trsuma  disorders  that  increase  absenteeism  end  reduce  productivity.  One  such 
disorder,  carpal  tunnel  syndrome,  is  associated  with  repetitive  forceful 
movements  of  the  hetvU  with  deviated  wrist  postures  and  is  characterized  by 
pain  end  numbness  in  the  hand  end  wrist. 


1  This  Research  is  sponsored  by  the  Department  of  Defense,  Defense 
Logistics  Agency.  Mr.  Dsn  Gearing  serves  as  the  program  Technical  Monitor. 
The  authors  would  like  to  thank  Ms.  Lisa  C.  King,  Ids.  Catherine  Braza,  and 
Mr.  David  Norman  for  their  assistance. 


discoafort  c*n  p-rovide  iaiportasit  cIucb 
end  job  d««i^  problcos.  In  *ddi.ticm»  tK±s  information  ia 
eittaJblialiisiS  prioriti^a  for  automation  of  particular  manual 
:':9pj[^jktidn.s.i.  If  oparacloxia  that  are  particularly  streaafol  to  the 
jTf^  aj.atam  can  ba  modlflad  to  alislaata  diacomfort  or  can  he 

-aiicti^aaf^lly  automatady  it  will  ba  aaaler  to  retain  experienced »  skilled 
and  to  oaintAin  their  productivity. 

Caraful  daaign  of  tooJLa  and  aqulpt&ant  for  tha  vorkplace  requiras  the 
enginaar  to  obtain  and  apply  data  on  tha  ralavant  phyalcal  dimensions  of  the 
vazkax  population.  Such  data^  howavery  are  not  readily  available  for  moat 
civilian,  populations  including  apparel  cutting  and  sewing  operators.  Casay 
(lS8:9}  .d9>)on8trated  the  ioprecialon  in  aqulpmeL.:  design  that  can  result  from 
attesq»ta  to  apply  the  few  existing  civilian  anthropcoatrlc  dlata  bases  to  the 
dekign  of  aquipasent  for  specific  user  populations.  Data  ware  needed  on  the 
phyafcul  di2asnaions  of  tha  apparel  manufacturing  operator  population. 

Training  of  manufacturing  workers  is  a  significant  issue  because  of  the 
high  rate  of  turnover  e^^arlencad  by  the  industry  and  bacauae  of  the  lengthy 
hiazhlng  tiaa  required  to  reach  proficiency  on  many  of  tha  more  demanding 
jobs.  Traavsahly«  ineraasing  tha  effaetivanass  of  training  could  provide 
multipla  banafits  by  enabling  vockara  to  achieve  t&ore  productivity  and, 
ccmaequantly ,  mora  rewarding  rates  of  pay  earlier  in  their  careers.  It  might 
also  help  to  reduce  the  Incidance  of  hic&ardous  work  habits  that  contribute  to 
th«  frequent  nusculoskelatal  pains  and  diaordara  fovmd  in  tha  Industry. 


Hatbod 

Site  vlaita  ware  conducted  at  three  plants  that  manufacture  trousers  in 
the  Southeastern  United  Stetes .  Tha  plants  ware  aelected  to  provide  a  raxigs 
of  company  aisas  (SO  -  600  amployaa.^)  and  degrees  of  automation  that  is 
typical  of  the  Industry.  Two  of  tha  three  produce  ozxly  military  uniform 
trouaecs  while  the  third  produces  a  range  of  casual  and  dress  trousers. 

A  total  of  132  operators  at  tha  three  sltaa  volunteered  to  take  part  in 
tha  research.  Of  these  operators,  123  vara  famals  and  9  were  mala.  Tha 
participants  had  a  mean  egc  of  40  years  and  a  mean  of  8.5  years  experience  in 
the  apparel  industry.  These  demographics  appeared  to  ba  representative  of  the 
opsrator  populations  c£  the  apparel  manufacturing  plants  ve  visited.  Data 
coUaction  took  place  before  and  after  work  end  during  lunch  brea3cs . 

Anthropdaetric  measures  were  taken  on  all  participants.  Subjects  were 
maasured  on  each  of  tan  dimansions  related  to  workstation  and  operator 
interface  Including  (1)  stature,  (2)  eye  height,  (3)  shoulder  height,  (4) 
standing  elbow  height,  (5)  arm  length,  (6)  seated  height.-  (7)  popliteal 
height,  (8)  thigh  thickness,  (9)  hand  length,  and  (10)  hand  breadth.  The 
measuring  davlcaa  vara  a  GPH  Model  101  anthropomscer  and  a  Ct^  Model  106 
spreading  caliper.  Subjects  vers  maasured  with  shoes  removed  and  were  wearing 
lightweight  summer  clothing. 

Confidential  Interviews  ware  conducted  with  all  subjects  using  a 
structured  interview  form.  The  interviews  covered  (1)  demographic 
Information,  (2)  muaculoakoletal  injuries  or  discomfort,  (3)  the  Job 
enviroiaaant,  (4)  characteristics  of  the  workstation,  chair,  and  Job,  (5) 
training,  (6)  work  schedule,  (7)  other  factori  that  might  influence  safety  or 
productivity.  To  promote  uniformity,  most  o£  the  interview  consisted  of 


YES/HO«  iBiiltlple  choice,  or  short  srswer  questions.  The  finel  two  questions, 
however,  ware  open-ended  and  interviewers  attempted  to  draw  out  more  detailed 
information  on  previous  responses  or  suggestions  for  job  improveaient . 

Based  on  indicators  of  human  factors  problems  such  as  high  turnover  or 
absenteeism,  a  history  of  complaints  or  Injuries,  or  unusually  high  skill 
requirements,  14  target  jobs  ware  selected  for  more  detailed  study.  Video 
registration  and  analysis  using  methods  described  by  Keyserling  (1986)  and 
Melin  (1987)  were  used  to  record  and  score  hand,  wrist,  back,  and  neck 
position  and  activity  of  the  selected  operators  during  sewing  operations. 
Measurements  of  the  "problem"  workstations  were  also  taken. 

Ambient  noise  and  noise  levels  at  the  operators’  ears  were  measured  at  a 
sample  of  workstations  in  each  facility  using  a  General  Radio  Model  1982  Sound 
Level  Meter.  Measures  of  ambient  illumination  and  the  illumination,  at  the 
workstation  point-of -operation  (POO)  with  supplementary  task  luminaires  (if 
normally  used)  were  taken  with  a  Gossen-Panlux  light  meter. 


Results 

Anthropometry 

Table  1  susemarizes  the  mean,  Sth  parcentile,  and  9Sth  percentile  values 
for  each  of  the  ten  measures  taken  of  the  123  female  volunteers  in  the  study. 
Compared  to  other  sources  of  anthropometric  data  on  civilian  females  (Webb 
Associates,  1978;  Society  of  Automotive  Engineers,  1983)  the  population  of 
sewing  operators  appeared  to  be  slightly  smaller  (based  on  stature,  seated 
height,  etc.)  and  slightly  heavier  (based  on  thigh  thickness). 


TABLE  It  AHTHROPCWETEIC  DATA  FOR  123  FEMALE  SEWIMG  OPERATORS 


DIMENSION 

MEAN 

S.D. 

STH  2ILE 

9 STH  ZILE 

STATURE  (cm) 

160.7 

6  e4 

150.2 

171.2 

EYE  HEIGHT  (cm) 

150.6 

6.2 

140.5 

160.7 

SHOULDER  HEIGHT  (cm) 

133.3 

5.9 

123.7 

143.0 

ELBOW  HEIGHT  (cm) 

103.1 

4.5 

95.6 

110.5 

ARM  LENGTH  (cm) 

69.8 

3.6 

63.9 

75.6 

SEATED  HEIGHT  (cm) 

84.2 

3.5 

78.5 

90.0 

THIGH  THICKNESS  (cm) 

15.0 

2.1 

11.6 

18.5 

POPLITEAL  HEIGHT  (cm) 

41.7 

2.5 

37.6 

45.8 

HAND  LENGTH  ( cm) 

17.5 

0.9 

16.1 

18.9 

hand  breadth  (cm) 

7.8 

0.4 

7.1 

8.5 

Paatural .Pigggnf art 

As  shown  in  Figure  1,  about  half  of  all  interviewed  workers  reported  that 
they  at  least  "sometimes"  suffer  frOTi  pain  in  their  upper  back  (522),  neck 
(492),  and  right  hand  (482).  Based  on  interviews  with  methods  engineers  and 
observation,  the  jobs  were  classifiad  as  low,  medium,  or  high  in  manual 
manipulation.  Operators  in  high  marJ-pulation  jobs  reported  a  substantially 
higher  frequency  of  pain  in  the  hands,  snas,  shoulders,  middle  and  upper  back, 
and  neck  than  did  the  operators  in  the  low  manipulation  jobs.  These  operators 
also  reported  a  high  incidence  of  pain  and  numbness  in  the  hands  and  fingers, 
one  ccHumon  early  symptom  of  carpal  tunnel  syndrome. 


Oparatoirfi  in  *t«nd±ng  jobs,  ae  nigbt  be  expected,  reported  significantly 
greater  aaoiicts  of  foot  discoafort  and  less  discomfort  in  the  back  and  neck 
than  did  operetore  in  sitting  jobs.  An  additional  trend  found  leas  discomfort 
being  reported  by  older  workers  than  yccnger  workers.  This  tnight  be 
attributed  to  a  reticence  on  the  part  ci  older  workers  to  report  job-related 
discomfort,  to  a  reassignment  of  older  v-'orkers  to  less  demanding  jobs,  or  to  a 
self-selection  of  individuals  susceptible  to  cumulative  trauma  disorders  out 
of  the  apparel  manxifacturing  workforce. 

Video  analyses  were  performed  on  a  sample  of  30  operators  of  varying 
experience  levels.  Differences  between  experienced  and  novice  operators  were 
examined.  Experienced  operators  were  found  to  make  fewer  and  more  ballistic 
hand  movements  during  a  given  cycle.  Because  experienced  operators  performed 
many  more  cycles  per  unit  of  time  than  the  novice  workers,  however,  their 
level  of  hand  activity  was  greater. 

Video  analyses  were  performed  on 
the  postures  of  these  sewing  operators. 

During  the  machine  cycle,  40  percent  of 
these  operators  stooped  forward  (i.e., 
torso  flexion)  at  least  20  degrees 
during  the  cycle.  Sixty  percent  of  the 
operators  tULted  their  heads  forward 
mora  than  20  degrees  throughout  most  of 
the  cycle.  Such  hunched  postures  have 
bean  cited  as  a  factor  associated  with 
fatigue  and  discomfort  (Grandjecn,  198S). 

The  prevalence  of  this  hunched-over 
working  posture  la  probably  the  result 
of  two  factors,  visual  requirements 
and  workstation  geometry.  The  quality 
requirements  of  the  sewing  job  require 
clear  visual  perception  of  the  POO. 

Yet,  measures  indicated  that  average 
illumination  levels  at  the  POO  ( 168 
fooccsndles)  were  substantially  lover 
than  the  recommended  values  (300 
footcandles) .  During  interviews,  36 
percent  of  the  operators  complained  of 
inadequate  illumination. 

Measures  of  the  typical  workstation 
Indicated  that  the  mean  position  of  the 
foot  treadle  was  only  IS  cm  from  the 
proximal  edge  of  the  work  surface. 

Commonly,  operators  positioned  the  chair 
back  away  from  the  work  surface  in  order 
to  allow  an  optimum  knee  angle  of  110 
degrees  or  greater.  Because  of  the  resulting  distance  from  the  chair  to  the 
work  SurfacB,  the  average  reach  required  was  84  cm,  nearly  doubli-,  the 
reccaaoended  45  cm  (Eastman  Kodak,  1983).  From  this  chair  position,  operators 
were  required  to  lean  forward  25  degrees  or  more  in  order  to  have  adequate 
visual  and  manual  access  to  the  POO. 


Figure  1.  Percentage  of  Workers 

Reporting  Musculoskeletal 
Discomfort  by  Body  Area 


1 
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{}a.%he>job  training  vaa  cha  eundard  at  all  three  sites.  Only  one  plant 
used  a  dedicated  training  staff;  at  the  ocher  two,  training  was  provided  by 
the  floor  supervisors.  None  of  the  trainers  at  any  of  the  sites  had  any 
foratal  Instruotion.  in  effective  training  nethoda.  The  quality  of  instruction 
and  performance  feedback  varied  between  and  within  plants.  Only  17  percent  of 
the  operators  reported  that  they  had  ever  been  provided  with  any  kind  of 
wxlttac  or  graphical  training  or  Job  performance  aid.  Thirteen  percent 
reported  that  some  use  of  vi^otape  was  made  in  their  training,  most  often 
during  cross-training  for  a  second  position. 


Discussion 

Among  Slewing  operators,  complaints  of  musculoskeletal  discomfort  centered 
in  the  torso  and  upper  extremities.  Analyses  suggested  that  these  complaints 
can  be  partially  addreeaed  by  adequate  workstation  and  chair  adjustability  as 
wall  as  by  loprcrved  llluninatlon. 

Research  Is  needed  to  determine  the  actual  prevalence  of  chronic  trauma 
disorders  in  trouser  mecufacturlng.  Our  results  suggest  that  the  prevalence 
may  be  consldersAly  higher  than  reported.  The  operations  studied  here  were 
all  hand- intensive.  Beducing  the  frequency  of  high  risk  hand  motions  will 
require  modification  of  workstations  and  methods;  eliminating  the  use  of  these 
motions  altogether  will  require  automation. 

More  effective  training  could  improve  productivity  and  increase  safety. 

We  would  recommend  improvements  in  four  areas:  (I)  Improved  training  for  the 
training  staff,  (2)  increased  use  of  training  aids,  (3)  better  performance 
feedback  during  training,  and  (4)  more  etapbasis  on  injury  prevention  and 
posture  training. 
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Abstract 

Hendzick  (1388)  introduced  "aacro-ergonooics"  to  direct 
attention  toward  hucsan-huean  interaction  in  addition  to  huaan- 
aachine  interactions-  "his  conceptual  reorientation  is  advocated  as 
a  foundation  for  inproving  organiMtional  perforaance.  This  paper 
oifers  some  conjecture  about  the  relationship  aaong  learning, 
decision  making,  commuhlcation,  and  organizational  performance  in 
the  context  provided  by  macro-ergonomics . 

itacro-ergoncaics  refocuses  attention  toward  the  transactions  occurring 
between  organization  members.  Transactions  between  entities  range  from 
exchanges  of  labor  and  money  to  exchanges  of  power  and  Influence  (Jones, 
1383).  Moreover,  Levine  and  White  (1961)  claim  that  exchange  is  a  useful 
framework  for  studying  organizations.  This  paper  examines  macro-ergonomic 
exchanges  from  three  perspectives  in  order  to  develop  conjectures  about 
learning,  decision  making  processes,  communication  processes,  and 
organizational  performance. 

Three  Perspectives  on  Exchange 

The  first  perspective  looks  at  crg&nlzatlons  from  a  cognitive 
perspective.  This  view  assumes  that  mental  maps  fora  the  basis  of 
organization  reality  and  roles  (ixgytls  and  5chon,  1978).  Mental  maps,  clthe 
public  ox  private,  explicit  or  implicit,  are  the  shared  beliefs  of 
organizational  members  used  to  guide  actions  and  attach  meaning  to  events. 
Learning  occurs  as  the  content  and  linkage  between  concepts  in  these  naps 
chano-^3  (Argyris  and  Schon,  1978). 

Interacting  with  the  environment  allows  members  nf  an  organization  tc 
create  new  interpretations  of  their  circumstances  (Argyris  and  Schoa,  1978). 
Sew  meanings  are  stored  as  mental  maps  that  are  transferred  to  the 
organization  through  communications  systems  and  guide  the  members'  behaviors. 
For  example,  SOPs,  policy  manuals,  procedures,  contracts,  and  laws  describe 
how  organizational  roles  can  or  must  respond. 

Organization  theory  generally  accepts  t.hat  an  organization's  primary 
objective  is  tc  insure  organizat icn.al  survival  by  seeking  a  "fit"  vith  the 
environment  (Thompson,  1967;  Tcsl,  1904).  Those  exchanges  with  the 
environment,  which  are  required  for  learning,  ate  the  primary  source  of 
uncertainty  managers  must  accommodate  (Thompson,  1976).  High  performance  and 
strategic  advantage  are  achieved  by  fitting  the  organization  tc  the 
environment  and  ainimizi.ng  the  costs  of  the  exchanges  required  to  achieve  a 
fit  (Thompson,  1987;  Tosi,  1334). 
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The  uncertainty  created  by  environnantal  interactions  cf  open  systens 
prompts  rational  organizations  to  forecast  probleas  and  develop  responses  to 
anticijiated  probieszs.  Unfortunately,  aiany  problass  cannot  be  deterained 
PjfSori  because  of  incospiete  or  unknown  cause-effect  relationships.  Leaders 
and  aaragsrs  are  called  upon  to  work  out  sexe  aechanisx  to  handle  probleas 
arising  fros  unexpected  situations.  Kolb  {1974'  observed  that  learning  and 
problea  solving  are  different  perspectives  of  the  sane  issue. 

&  second  view  of  the  aacro-ergcncsic  aodel  develops  frox  the  notion  that 
leaders  are  called  upon  to  solve  prcblecs  by  aaking  decisions.  Sixen  11975) 
observed  every  decision  has  two  coaponents,  facts  and  values.  Facts  are 
empirically  testable  but  values  are  derived  from  aorals  or  personal 
preferences,  inother  perspective  on  this  classification  is  provided  by 
Laugnlin’s  decision  making  research  (McGrath,  1984).  Decision  aaking  tasks 
aay  be  classified  as  either  intellective  tasks  or  judgaental  tasks. 
Intellective  tasks  are  these  which  have  a  demonstrably  "correct"  answer; 
judgmental  tasks  do  not.  Ir.tellective  task  "correctness"  is  established  as  a 
social  phenomena.  For  example,  accepting  the  rules  of  evidence  established  by 
a  science  as  an  indicator  of  truth  or  following  legitimate  procedures  within 
mathematics,  engineering,  and  logic  are  considered  Indicators  cf  correctness. 
In  the  judgmental  category,  a  "correct"  answer  is  based  upon  consensus  among 
peers,  preferred  outcomes,  moral  judgments,  and  values  (McGrath,  1984). 

A  third  perspective  on  exchanges  is  that  comaunication  is  the  transfer  of 
information  between  entities  (Daft  &  Huber,  1987;  Veick  &  Browning,  1988). 

The  transfer  can  be  viewed  from  two  different  communication  paradigms, 
argument  and  narration  (Weick  and  Browning,  1988)  .  irguaent  requires 
rational  evaluation  based  upon  a  coherent  set  of  rules  established  a  priori. 
Technical  expertise,  public  debate,  common  goals,  and  demonstration  of  truths 
are  valued  in  this  form  of  comaunication.  On  the  other  hand,  narrative 
comaunication  assumes  "values  arc  ultimately  persuasive  ...  soundness  is  the 
essential  standard  of  reasoning.  (Seick  5  Browning,  1986:  249)" 

Since  the  objective  of  an  crga.iization  is  to  achieve  a  fit  with  its 
environment,  making  a  correct  decision  relative  to  the  problem  addressed  is 
essential.  Intellective  and  judgmental  tasks  can  be  lefraaed  in  terms  of 
their  source  of  validation  being  either  internal  or  external  to  the  exchange. 
Therefore,  judgmental,  or  value  based  decision  making,  has  significant 
organixaticnil  implications  since  it  establishes  the  idiosyncratic 
organizational  understandings  which  are  central  to  an  organization's 
uniqueness.  Effective  judgmental  decision  aaking  supports  developing  a 
strategic  advantage  by  attaching  a  unique  meaning  to  events  and  sharing  that 
meaning  through  culture,  shared  mental  maps,  and  interpretive  schema. 

Achieving  strategic  advantage  or  maintaining  superior  performance  is  a 
ubiquitous  goal  of  organizations.  The  macro-ergonoaic  framevoik  focuses  on 
the  human  interaction  to  achieve  that  goal.  The  three  notions  discussed  add 
several  additional  insights  into  exchange  processes. 

1.  Exchange  is  a  fu.ndaaental  process  of  organized  activity  in  an  open 
system. 

2.  Exchange  is  necessary  for  learning  but  it  creates  uncertainty. 

3.  Uncertainty  is  reduced  by  increasing  informaticn;  iiiforsation  is 


4. 


Cheated  vhen  data  are  applied  to  influer.ee  a  choice,  that  is,  nake  a 
decision. 

Decisions  rely  on  one  of  two  standards  for  judging  performance, 
rules  or  social  consensus. 

Tne  iolloving  is  a  conjecture  about  how  the  insights  may  be  applied  to  macro- 
ergonoaic  processes  and  extended  to  sabsuae  aicro-ergononic  processes. 

Linking  Macro-Ergonomics  and  Exchange 

k  link  berveen  the  tvo  models  can  be  made  by  assuaing  that  all  G.-<changes 
must  be  mediated  by  a  third  party  (Weick,  1969).  At  a  pragmatic  level  this 
assumption  can  be  tested  by  asking,  "What  is  the  role  of  a  leader  or 
supervisor?*'  Thetr  roles  assign  then  responsibility  over  certain  domains. 

They  may  eitl t.t  establisn  procedures  or  make  decisions  when  procedures  are  not 
available.  11  the  problem  is  outside  of  their  domain,  they  can  refer  it  to 
others  and  the  c/cle  repeats.  They  act  to  mediate  exchanges  within  their 
domain. 

The  aicro-ergononic  model  can  be  tested  in  a  similar  manner  by  asking, 
"What  is  the  role  of  standards  or  procedures?"  They  guide  the  interaction. 

The  human  factors  approach  is  used  to  establish  procedures  and  machine 
standards.  In  fact,  the  same  rationale  could  be  extended  to  standards  imposed 
on  one  machine  interfacing  with  another.  These  concepts  are  represented  in 
Figure  1. 


Figure  1. 


Macro-Srgonoaic  Exchange  Model 


This  model  suggests  several  facets  that  a  manager  aust  consider  as  either 
a  designer  of  a  macro-ergon ic  e.xchange  or  as  a  partiepant  in  the  exchange. 
First,  one  aust  consider  control  of  the  exchange  within  the  assigned  area  of 


area  of  responsibility  or  when  the  rules  have  been  established  by  external 
governing  bodies. 

Second,  one  aust  consider  the  processes  used  establish  the  exchange 
perfornance.  In  circuastances  where  the  perfcrnance  can  be  judged  according 
to  preexisting  standards,  those  standards  aay  be  used.  Deterning  the 
availability  of  standards  aay  not  be  easy  since  it  may  require  using  experts 
or  finding  difficult  to  comprehend  procedures.  On  the  other  hand,  the 
alternative  is  to  "reinvent-the-wheel"  which  is  an  expensive  and  tiae- 
consuiaing  process. 


Third,  one  must  consider  the  nature  of  the  comaunication  process.  In 
general,  organicaticnal  theorists  espouse  the  benefits  of  using  a  rational 
approach  to  coamuni cat  ions.  However,  the  problem  may  not  have  the  factual 
basis  required  to  use  this  communication  strategy.  In  this  circumstance,  the 
strategy  is  inappropriate  for  the  problem.  In  other  words,  the  decision  maker 
aay  fail  to  "fif*  the  organisational  process  to  the  problem  environment,  which 
aay  lead  to  lover  performance. 


The 

ergonnlc 


three  components  of  the  decision  process  associated  with  a  macro- 
perspective  are  sumnarired  in  Table  1. 


Table  1, 


Macro-Erogomic  Decision  Processes 


Domain  of  1 

Decision  Control  | 

Internal 

External  j 

Evaluation  and  i 

Judgmental 

Intellectivi;  | 

Decision  Making 

.. 

1 

Comaunication 

Narration 

Argume.nt 

Process 

1 

as  shown  in  Table  1.,  the  essential  feature  of  the  exchange  is  origin  of  the 
the  control  process. 


Summary 

Organizations  exist  as  sets  of  exchanges  guided  by  their  mental  maps  and 
laaintained  by  high  performance  decision  making.  Exchange  provides  a  useful 
model  for  integrating  learning,  decision  making,  coBBunication,  and 
performance  evaluation. 

References 


D.  A.  Schon  {1978).  Oro-anic-at: icn.nl  beaming:.  .A  hheerv  of  .Action 
Add iscn-Wesley,  Reading,  HA. 


"How  Organizations  l. 


Daft,  R.  L.  &  G.  P.  Huber  (1987). 


earn;  A  ComiEuni  cat  runs 


Fraaevork,"  Research  in  the  SociolQ.qy  of  .Organizations, 


-36. 


Hendrick,  H.  (1988).  "Hacroergonomics :  i  Systea  Design  Approach  for 
Developing  More  Effective  Military  Systeas,"  Proceedings  .Psychology,  in  the 
Pppartraent  of  Defense.  Eleventh  SvnsosLua.  April  13-15,  57-61. 

Jones,  G.  R.  (1983).  Transaction  Costs,  Property  Rights,  and  Organizational 
Culture:  An  Exchange  Perspective.  Adninistrative  Science  Quarterly.  28,  454- 
467  . 


Kolh,  D.  A.  (1974).  "On  Hanagenent  and  the  Learning  Process,"  in  Kolb,  D.  A 
Rubin,  1.  H.,  and  MacIntyre  (Eds),  Craanicational  Psychology.  Prentice-Hall, 
Englevood  Cliffs,  NJ. 


t 


Levine,  S.  4  p.  E.  White  (1961).  Exchange  as  a  Conceptual  Fraaevork  for  the 
Study  of  Interorganlzatlonal  Relationships,  Adcinl?*-rative  science  Quarterly, 
5,  583-601. 

McGrath,  J.  E.  (1984).  Groups.  Interaction  and  Perfornance.  Prentice  Hall, 
Englewood  Cliffs,  NJ. 

Simon,  H.  A.  (1976).  Administrative  Behavior.  3rd  Ed,.  The  Free  Press,  New 
York,  NY. 

Thompson,  J.  D.  (1967).  Qiganis.aUQIlS,..in,  McGrav-Kill,  Hew  York,  N.Y. 

Tosi,  K.  L.  (1984).  Theories  of  Organization.  John  Wiley  5  Sons,  New  York, 
NY. 


Weick,  K.  E.  (1969).  The  Social  Psychology  of  Organizing.  Addison-Wesley, 
Reading,  MA. 

Weick,  X.  E.  and  Browning  (1986).  "Argument  and  Narration  in  Organizational 
Communication,"  Journal  of  Hanaoement.  12(2),  243-259. 


65 


Huoan  Responses  to  Weightlessness 

Orrfyn  Saopson,  PhD 
United  States  Air  Force  Aci^ieisy 

Abstract 

An  Introduction  to  the  phenomenon  of  weightlessness  is  presented  in  terms 
of  its  cause  and  its  effects  on  the  human  body.  Following  a  discussion  of 
just  what  weightlessness  is,  its  major  physiological  effects  are  reviewed. 
These  include:  1)  altered  body  orientation  stemming  from  ihe  removal  of  a 
major  source  of  sensory  stimulation  of  the  vestibular  apparatus  contained 
within  the  inner  ear;  2)  body  fluid  shifts  resulting  in  compensatory 
cardiovascular  system  responses;  and  3)  changes  in  body  composition, 
especially  muscle  and  bone,  with  prolonged  exposure  to  weightlessness. 

Each  of  these  effects  is  discussed  with  the  goal  of  understanding  its 
etiology.  In  addition,  implications  for  human  movement  in  space  and  on 
earth  are  given. 

WEIGHTLESSHESS 

There  is  a  common  misunderstanding  about  weightlessness.  We  have  developed 
the  notion  that  weightlessness  and  space  go  together,  that  people  become 
weightless  whenever  they  go  beyond  the  earth's  atmosphere. 

We  have  acquired  this  notion  naturally.  For  years  now,  we  have  become 
accustomed  to  seeing  astronauts  and  cosmonauts  "floating  around"  inside 
their  spacecraft  once  they  achieve  aartb  orbit.  And,  since  the  orbit 
altitude,  usually  150  •  jOO  miles,  is  beyond  our  atmosphere,  it  is  natural 
to  associate  weightlessness  with  a  lack  of  atmosphere;  i.e.,  with  space. 
This  association  is  natural,  but  in  fact,  it  is  only  coincidental. 

According  to  Newton,  every  object  in  the  universe  attracts  every  other 
object.  The  amount  of  attraction  that  exists  between  two  objects  is 
directly  related  to  their  masses  and  Inversely  related  to  tne  distance  they 
are  from  each  other.  Because  gravity  is  universal,  a  state  of  absolute 
weightlessness  could  exist  only  if  you  were  present  in  an  empty  v?ni verse. 
And,  since  that  is  hardly  feasible,  our  conception  of  weightlessness  needs 
to  be  adjusted.  To  understand  it  properly,  ws  need  a  fraune  of  reference. 

To  illustrate:  on  earth,  we  experience  our  mass  as  weight  because  the 
earth  pushes  up  on  us  opposing  gravity's  pull,  Tf  the  earth  suddenly  gave 
way,  we  would  no  longer  experience  our  mass  as  weight  because  there  would 
be  nothing  to  oppose  the  pull  of  gravity. 


When  space  travelers  appear  to  be  weightless  in  orbit,  as  we  have  just  been 
reminded,  they  are  not  free  of  gravity.  Instead,  ’’hey  are  falling.  They 
are  still  being  attracted  to  the  earth  and  are  falling  toward  it,  but 
because  they  have  a  forward  velocity  (of  some  17,000  opt),  they  keep 
missing  it.  And,  since  their  spacecraft  is  also  falling;  using  It  a 

frame  of  reference,  they  are  Indeed  weightless.  In  other  works,  they  are 


weightless  relative  to  their  spacecraft. 


Therefore,  what  we  have  come  to  regard  as  weightlessness  is  simply  a  state 
of  free  fall  in  which  our  frame  of  reference  is  movii^g  in  the  same 


diPA^tion  and  at  the  sase  speed  we  are.  This  lotting,  the  case,  it  is  now 
easier  to  see  that  welghtlessaess  has  nothing  to  do  with  space  per  SE. 
Indeed e  we  experience  weightlessness  within  our  atmosphere  every  time  we 
are  free  fr^  support  and  are  allowed  to  feill.  When  a  pilot  noses  his 
plane  over  after  a  gradual  climb,  or  an  elevator  descends  abruptly,  we 
experience  weightlessness.  The  only  difference  is  in  the  duration. 

Because  this  is  such  a  foundational  concept,  let  us  illustrate  It  another 
way  be  considering  an  implausible  situation. 

Suppose  we  built  a  skyscraper  2SQ  miles  high.  The  person  living  in  the 
penthouse,  to  be  sure,  would  require  supplemental  air  to  breathe  because 
our  atmosphere  does  nob  support  life  much  beyond  about  five  miles 
elevation.  But.  mark  this,  be  or  she  would  not  be  weightless!  In  fact, 
their  weight  would  be  diminished  by  a  mere  12!(,  and  that  not  because  of 
space,  but  because  they  are  now  250  miles  further  from  the  center  of  the 
earth. 

As  we  move  out  from  the  earth,  our  weight  indeed  diminishes.  But,  distance 
from  the  earth  is  not  the  only  factor:  The  penthouse  dweller  and  the  space 
traveler  are  the  same  distance  from  earth,  but  one  still  has  weight,  the 
other  does  not.  The  difference,  of  course,  is  accounted  for  by  the  fact 
that  the  space  traveler  and  his  spacecraft  are  both  falling. 

To  put  this,  hopefully,  in  even  clearer  perspective,  here  is  a  view  of  the 
earth  from  the  moon.  Its  diameter  is  8,000  miles.  The  shuttle  altitude  is 
250  miles.  And,  on  an  8, 000-mile  scale,  250  miles  is  not  very  far  out  into 
apace.  Clearly,  these  space  travelers  have  not  escaped  the  earth’s  pull  of 
gravity! 

Hhat,  then,  is  the  correct  relationship  between  space  and  weight? 

The  short  answer  is  that  space  facilitates  free  fall  better  than  air  does, 
so  it  is  easier  to  orbit  in  space  than  within  our  atmosphere.  And,  that  is 
the  key.  While  it  is  possible  to  orbit  within  our  atmosphere,  air  provides 
so  much  resistance  that  the  cost  of  achieving  and  maintaining  a  forward 
velocity  of  17,000  mph  would  be  astronomioal  (and  I  know  it’s  a  pun). 
Conversely,  in  space,  where  there  is  practically  no  ispedii«ent  to  movement, 
speeds  of  that  magnitude  or  greater,  once  achieved,  can  be  maintained  with 
no  additional  power. 

With  the  advent  of  space  travel,  suuiklnd  faces  a  radically  new  experience, 
a  longterm  gravity-diminished  existence. 

As  of  the  first  of  this  year,  more  tnan  200  people  have  traveled  beyond  our 
atmosphere  with  a  collective  experience  of  21.4  manyears  in  space. 

Eventually,  with  the  advent  of  spaoe  station  and  trips  within  and  beyond 
our  solar  system,  the  weightless  experience  will  be  extended  perhaps 
indefinitely. 

Weightlessness  is  an  exhilarating  experience,  but  there  are  costs 
associated  with  it. 


PHYSIOLOGICAL  EFFECTS 


Exposure  to  laicrogravity  has  three  major  effects  on  human  bodies.  These 
Include: 

1.  Changes  in  bocy-envlronment  orientation  (nervous  system  effects). 

2.  Changes  in  body  fluid  distribution  (circulatory  system  effects). 

3-  Changes  in  body  structure  (primarily  effects  on  m’iscle  and  bone). 

Mervous  System 

A  primary  function  of  the  nervous  system  is  beisio  orientation — orientation 
of  your  body  with  respect  to  your  environment.  Orientation  involves  both 
sensory  and  response  activities  on  your  part.  The  primary  sensory 
mechanisms  include:  vision,  the  inner  ear,  and  somatosensory  receptors 
(Including  the  kinesthetic  sensors).  The  response  activities  Include:  eye 
movement,  changes  in  head  position,  £u:d  altered  posture. 

Uhen  the  environment  varies  beyond  certain  limits,  the  sensations  can  be 
disorientiog  and  may  produce  motion  sickness.  This  occurs  in  a  weightless 
environment . 

More  than  half  of  all  space  travelers  get  sick  in  microgravity .  The 
condition  is  labeled  space  motion  sickness  (SMS).  Soi^s  of  tne  symptoms 
include  nausea,  headache,  anorexia,  and  vomiting.  SMS  starts  almost 
immediately  for  some  astronauts  and  can  last  up  to  four  days. 

A  study  of  generic  motion  sickness  reveals  some  interesting  facts: 

1.  It  is  not  limited  to  t&an.  In  fact,  nearly  every  species  exhibits 
susceptibility  including  horses,  cows,  monkeys,  chimpanzees,  seals,  various 
kinds  of  birds,  sheep,  and  cats.  Even  fish,  under  the  right  conditions, 
exhibit  motion  sickness. 

2.  The  only  common  characteristic  uf  all  the  metions  producing  the 
syndrome  is  varying  accelerabiou  to  the  head  and  one  fact  stands  out: 
Individuals  not  possessing  a  functioning  vestibular  labyrinth  (e.g.,  some 
deaf  mutes)  are  not  susceptible  to  motion  sickness. 

The  vestibular  labyrinth,  or  vestibular  apparatus,  is  located  in  the  inner 
ear  and  is  continuous  with  the  structure  responsible  for  hearing,  the 
membranous  cochlea.  It  contains  two  types  of  senory  receptors:  otolith 
organs  which  sense  linear  accelerations  (including  gravity);  and, 
semicircular  canals  which  sense  euigular  accelerations. 

The  otolith  organs  (viz,  the  utricle  and  saccule)  are  linear  aecelsrometers 
and  provide  the  central  nervous  system  with  a  continuous  estimate  of  head 
position  with  respect  to  the  upright.  The  semicircular  car.als  are  robary 
accelerometers  and  detect  rotations  in  the  three  basic  planes  or  reference. 
Microgravity  alters  the  activity  of  the  i.-tollth  organs  but  not  the 
semicircular  canals.  This  leads  to  senory  conflict  and  space  motion 
sickness. 

Although  the  exact  nature  of  SMS  remains  a  mystery,  It  is  not  a  permanent 
condition  and  is  treatable  with  drugs  and  biofeedbaok  techniques. 


•  f*,  .-;  • 
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Clf oblatory.  Systeg 


HUcrogravlty  iuks  tw<^  effects*  One  la  an  iamediate  effect  of  redistributed 
body  fluids  rssultiss  frosi  decreased  bydrostatio  pressure*  This  leads  to 
thin  legs  and  a  puffy  face.  This  headMard  shift  of  fluids  is  interpreted 
by  the  bcdy  as  an  increase  in  blood  volusie.  The  circulatory  systes  adapts 
to  this  sensed  *'vo1usms  overload”  duicicly.  Vi  thin  the  first  day  or  tuo,  up 
to  tuo  liters  of  excess  body  fluids  are  excreted  and  the  number  of  red 
blood  cells  is  also  reduced. 


The  second  effect  of  microgravity  is  a  longterm  effect  in  which  the  heart 
Buisole  atrophies  and  certain  changes  are  seen  In  the  blood  which  are 
described  collectively  as  "spaceflight  anemia”.  Because  of  these  chanties, 
there  is  increased  likelihood  of  shock  if  hesc 'rhage  occurs.  And,  upon 
reentry  to  a  1-G  enviranceat,  orthostatic  tolerance  is  significantly 
diatnlshec.  Becovery  may  take  days  to  weeks. 


Heasuros  employed  to  counter  the  adverse  effects  of  miorogravity  itn  the 
circulatory  system  have  taken  a  variety  of  forms  and  include: 

1.  Inflight  aerobic  and  strength  training  exercises 

2.  Lower  body  negative  pressure 

3.  Oral  rehydration  (within  two  hours  of  reentry) 
brugs 

5.  Bormones 

6.  And  the  use  of  anti>G  suits  postfllght 


Muscular  Systems 

Shortterm  space  flights  do  not  impact  muscles  tc  a  significaot 
degree-- there  is  a  decrease  in  body  weight  but  this  Is  costly  water.  In 
longterb  flights,  both  body  water  loss  and  negative  nitrogen  balance  are 

seen. 


The  loss  in  muscle  occurs  mainly  in  the  lower  extremities.  In  addition  to 
the  loss  of  suscle  mass,  the  muscles  tend  to  "speed  up".  lu  other  words, 
the  atrophy  appears  to  occur  primarily  in  slow-twitch  fleers. 

Muscle  atrophy  can  be  effectively  countered  by  means  of  exercise, 
electrical  stimulation,  arid  hormones. 

Skeletal  System 

Osteopenia  (literally,  “poor  bones")  s  a  consistently  reported 
physiological  response  to  spaoef Light.  It  occurs  because  the  oogolug 
processes  of  bone  resorption  exceea  tnose  of  bone  formation. 


Spaceflight  osteopenia  is  acre  severe  than  bedrest  osteopenia  and  may  not 
oe  completely  reversible.  Bedrest  osteopenia  plateaus,  but  spaceflight 

US taOp«UJ.a  lias  ouii  aleaent  that  uO«a  uOt.  SpeOafllgilt  OotOOpSuia 

more  serious  than  post-menopausal  osteopenia.  A  rclcted  factor  in 
osteopenia  is  muscle  atrophy  because  of  the  stress  effect  muscles  have  on 
bones.  Postflight  there  is  increased  likelihood  of  boce  fracture 
and  at;  incr-eased  likeli.^ood  of  kidney  stone  formation. 
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Tvio  couat«na9a3ur«s  have  shown  some  benefit  in  retarding  bone  loss.  These 
^^.dj)td,lnde  exdrciae  and  diet,  but  osteopenia  is  not  totally  prevented  or 
.  iaiixerdad  uaihg  cither  countermeasure  and  it  remains  a  serious  effect  of 


Khat  does  all  this  mean  for  us?  I  thinic  there  are  three  major 
implications: 

Ghe  has  to  do  with  moving  oneself  in  a  miorogravity  environment. 

Ve  use  free  body  diagrams  all  the  time  to  describe  force  and  torque 
affects.  In  alerogravity,  «  bee  case  “free  Dodies. 

2.  A  second  implication  has  to  do  with  moving  other  objects  In  space, 
this  calls  for  a  concentrated  review  of,  and  experience  with,  the  physics 
of  siovemsnt  in  terms  of  forces,  centers  of  gravity,  torques,  mass,  etc. 

3-  And  a  third  implication  has  to  do  with  training-programs;  programs 


and  research  for  countering  the  adverse  effects  of  weightlessness  and 
preparing  apace  travelers  far  skilled,  efficient  movement  in  alerogravity. 
There  is  great  need  for  creative,  innovative  research  in  this  area. 
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(iender  Identity  jinong  Air  Force  Fenale  Aviators* 

Major  Karen  0.  Dunlvin,  Ph.D. 

USAF  Acadeny 


Abstract 

This  article  exaisines  one  facet  of  socialization  of  wonien 
in  the  aale^dcMiinant  world  of  flying  by  studying  Air  Force 
fetoaie  aviators'  gender  identity.  According  to  the  Bern  Sex 
Role  Inventory,  feicale  aviators  display  more  masculine  and 
androgynous  identities  than  other  women  surveyed  in  both 
adiit^ry  and  civilian  studies.  Forthernore ,  they  are  more 
likely  to  shift  toward  masculine  identities.  Interestingly, 
female  aviators  in  Tactical  Air  Coomand  (TAC),  the  predomi¬ 
nantly  male  fighter  command,  display  the  greatest  proportion 
of  masculine  identities.  These  findings  suggest  that  female 
aviators  adopt  more  masculine  identities  and  socialiy- 
desirable  masculine  characteristics  in  order  to  succeed  in 
the  male-dominated  world  of  flyir.g. 

Host  gender  studies  of  the  workplace  explain  observed  differences 
between  the  sexes  (e.g.,  behaviors  or  attitudes)  by  noting  individual 
differences  between  men  and  women  (e.g.,  physiological  or  psychological 
differences),  or  citing  contextual  factors  (e.g,,  organizational  structure  or 
socialization)  as  causes  for  the  observed  differences.  Additionally,  studies 
of  military  members  have  examined  gender  differences  and  role  socialization 
—  does  the  masculine  world  of  tbe  military  provide  similar  socialization 
experiences  for  men  and  wcaaen  (Hoskos,  1985;  Devilblss,  1985)?  Does  the 
military  reflect  a  gender-pluralistic  culture,  or  is  there  a  dominant 
masculine  culture  that  pressures  female  meicbers  to  adopt  more  masculine 
attitudes,  orientations,  and  identities?  Gender  is  an  important  element  in 
shaping  a  person's  self-image  and  social  identity  (Tischler  et  al.,  *986). 
Gender  identity  is  culturally  defined  (i.e.,  "appropriate'^  male  and  female 
behaviors  vary  by  cultures)  and  is  learned  through  role  socialization.  It  is 
an  acquired  identity  that  c'nanges  over  individuals’  life  cycles  and  cultural 
contexts . 

This  article  examines  gender  identity  among  Air  Force  female  aviators  — 
those  who  work  in  the  predominantly  masculine  world  of  flying.  Analysis  of 
gender  identity  of  women  in  masculine-dominant  cultures  may  provide  insight 
into  the  relationship  between  organizational  socialization  and  individual 
adaptation.  The  military  has  been  described  as  a  distinct  culture  that 
prcaootes  masculine  identities,  attitudes  and  behaviors  (Segal  and  Segal, 
1983).  Furthermore,  aviation  has  historically  been  considered  men's  work 
(Wood,  1982).  liowever,  military  women  are  born  female  (ascribed  status)  and 
develop  appropriate  gender  identities.  Therefore,  conflict  between 
organizational  and  gender  socialization  may  affect  gender  identity.  Thus, 
women  may  sacrifice  their  conventional  gender  identity  <i.e.,  femininity)  for 
a  masculine  identity  that  is  reinforced  ana  rewarded  in  the  iiiaaculiiie  world  of 

* 'Views'  expressed  in  this  paper  are  those  of  the  author  and  may 
not  reflect  these  of  the  U.S.  Air  Force  or  the  Air  Force  Academy. 


the  military.  This  pattern  may  be  more  pronouncea  for  women  who  perform  sex- 
prescribed  male  work  such  as  flying. 

A  common  measure  of  gender  identity  is  the  hem  Sex  Role  Inventory 
(B3RI).  Respondents  characterize  themselves  on  culturally  desirable  traits 
which  classify  their  sex-role  (or  gender)  identity  into  one  of  four 
categories;  masculine,  feminine,  androgynous,  and  undifferentiated  (Bern, 
1974).  Those  categorized  as  masculine  see  themselves  as  self-reliant, 
independent,  and  athletic  (culturally-defined  masculine  traits);  those 
classified  as  feminine  describe  theaseives  as  compassionate,  loyal,  and 
understanding.  Androgynous  individuals  describe  themselves  as  having  both 
strong  masculine  and  feminine  identities.  Undifferenciated  persons  are  low 
both  on  masculine  and  feminine  scores  --  there  is  no  distinguishable  pattern 
of  gender  identity. 

Androgyny  is  viewed  as  the  most  des5.rable  profile  because  it  depicts 
persons  who  attribute  both  masculine  and  feminine  traits  to  themselves  (Bern, 
1974;  (ksok,  1985).  In  short,  androgynous  persons  have  behavioral  flexibility 
to  positively  react  to  different  situations.  They  can  use  masculine  or 
feminine  characteristics  (e.g,,  be  forceful  or  compassioriate)  as  the  situation 
warrants  —  they  do  not  feel  constrained  by  rigid  sex-role  norms.  Conversely, 
undifferentiated  persons  have  no  well-defined  gender  identity.  Indeed,  some 
research  suggests  that  persons  categorized  androgynous  and  masculine  tend  to 
be  high  on  self-esteem  compared  to  fauinine  or  undifferentiated  persons  (Bern, 
1977).  Spence  ana  Helmreich  (1978)  describe  a  continuum  from  highest  to 
lowest  self-esteem  to  be  consistently  associated  with  the  four  groups  in  this 
order:  androgynous,  masculine,  feminine,  and  undifferentiated. 

Method 

Data  reported  here  are  part  of  a  larger  study  of  female  Air  force 
aviators  who  are  members  of  Women  Military  Aviators,  Inc.  (WMA).  The 
respondents  completed  a  140-item  questionnaire  that  included  various 
dejDOgraphic  and  attitudinal  questions.  This  study's  sample  (53  percent  return 
rate)  includes  120  active-duty  Air  Force  female  aviators  who  represent 
approximately  22  percent  of  the  total  population  of  Air  Force  female  aviators. 
Ideally,  ail  Air  Force  female  aviators  should  be  surveyed;  however,  time  and 
cost  constraints  prohibited  such  a  comprehensive  study.  Some  may  argue  that 
the  sample  may  reflect  unique  attitudes  of  those  who  belong  to  WMA.  However, 
in  my  interaction  with  female  aviators  (both  WMA  members  and  nonmembers),  I 
have  found  no  unique  profile  specific  to  either  group.  Therefore,  the  sample 
is  assumed  to  represent  Air  Force  female  aviators  in  general.  And 
deaographically,  the  respondents  are  diverse  in  terms  of  age,  years  of 
service,  military  rank,  and  major  conmand  (MAJCOM)  affiliation. 

Using  the  BSRI ,  two  scores  are  cal.culated:  masculinity  and  femininity. 
Research  consistently  reports  a  median  for  both  scales  at  approximately  ^1.9 
(Hyde  luid  Rosenberg,  1980).  As  discussed  earlier,  individuals  are  classified 
as  masculine,  feminine,  androgynous,  or  undifferentiated.  For  example,  if 
one's  masculinity  and  femininity  scores  (means)  are  above  4.9  (approximate 
medians),  the  respondent  scores  "high"  on  both  scales  and  is  classified 
aindrogyncus ;  one  who  scores  "low"  on  both  scales  is  termed  u.ndifferentiatea. 
Previous  research  reveals  that  the  E2F.I  is  a  valid,  reliable  measure  of  gender 
identity  (Cook,  1985). 
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Results 


Table  1  presents  coitparative  studies  reporting  BSHI  scores  (this  study’s 
data  are  listed  on  the  top  row).  The  overall  mean  scores  of  inasculinity  and 
femininity  for  the  surveyed  Air  Force  female  aviators  are  5.5  and  it.9, 
respectively.  Using  the  accepted  normative  median  scores  of  ^.9  for  both 
scales,  Air  Force  female  aviators  do  not  have  conventional  gencer  identities 
(i.e.,  feminine  identities).  Instead,  they  have  more  masculine  and 
androgynous  identities  (42  and  45  percent,  respectively).  Conversely,  few 
female  aviators  have  feminine  identities  (10  percent)  which  sharply  contrasts 
with  studies  of  norumilitary  women  (34  to  52  percent). 


TABLE  1 

PERCENT  DISTRIBUTION  0?  WOMEN  IN  SEX-ROLE  CATEGORIES 


K  = 

Undifferentiated 

Feminine 

Mascui ine 

Androgynous 

BSRI® 

120 

3? 

10% 

42% 

45% 

B3RI° 

35 

e% 

8% 

26% 

60% 

BSRI^^ 

290 

20% 

34% 

16% 

29% 

BSRI'^ 

369 

^9% 

47% 

10% 

24% 

BSRI® 

165 

13S 

52% 

15% 

20% 

BSRI* 

85 

15% 

49% 

14% 

21% 

Sources : 

^  Dunivin,  1990  (Air  Force  female  aviators) 

°  Dunivin,  1988  (Air  Force  female  officers) 

^  Bern,  1977  (male  and  female  college  students) 

“  Hoffman  and  Fidell,  1979  (adult  women,  age  20-59) 

®  Hyde  and  Phillis,  1979  (males  and  females,  age  13-85) 

*  Derleur  and  Warner,  1987  (Air  Force  Academy  female  cadets) 

Notes : 

1.  Percentages  are  computed  by  rcws. 

2.  Percentages  nay  not  add  to  lOOi  because  of  rounding. 


Most  striking  are  the  differences  in 
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identities  oaiy  account  for  34  to  45  percent  of  the  sample  —  a  startling 
difference . 

Comparing  tw-o  similar  populations  (i-e.,  Air  Force  female  officers 
[Dunivin,  1988]  and  these  aviators),  there  are  similarities  and  differences. 
The  median  scores  are  similar  (Dunivin  [1988]  reported  medians  of  5.6 
masculinity;  5.05  femininity).  Likewise,  the  percentages  are  similar  for  the 
combined  categories  of  masculine  and  androgynous  identities.  However,  female 
aviators  have  more  masculine  identities  (42  percent)  ttian  Air  Force  female 
officers  (26  percent).  This  difference  suggests  a  shift  toward  more  masculine 
identities  for  female  aviators  than  female  officers  in  general. 

Examining  gender  identity  axoong  the  various  subgroups,  there  are  few 
discernible  patterns.  Factors  such  as  military  rank,  age,  commission  source, 
marital  status,  and  career  intentions  show  no  distinct  patterns.  However,  one 
pattern  appeftrs.  Female  aviators  in  MAC  and  SAC  have  a  balance  between 
masculine  identities  (38  pjercent  and  30  percent,  respectively)  and  androgynous 
identities  (52  percent  and  54  percent,  respectively).  However,  SO  percent  of 
the  surveyed  female  aviators  in  TAG  have  masculine  identities  ana  none  have 
feminine  or  undifferentiated  identities.  This  pattern  may  suggest  that 
military  women  in  the  most  masculine  culture  of  TAC's  fighter  world  adopt 
almost  exclusively  masculine  identities. 

Discussion 

When  examining  BSRI  scores  in  the  different  studies  (Table  t  ) ,  some 
differences  may  be  attributed  to  the  diverse  populations  of  the  studies.  For 
example,  two  studies  use  college  students  as  subjects,  a  rather  specialized 
segment  of  a  society's  population.  Still,  the  findings  siiggest  some  important 
differences  with  alternate  plausible  explanations .  First,  none  of  the  studies 
(except  Dunivin,  1988)  measure  professional  career  women's  gender  identity. 
For  the  most  part,  career  women  in  management  positioas  (including  Air  Force 
female  aviators)  work  in  an  organizational  culture  in  which  leadership, 
assertiveness,  and  other  male-attributed  qualities  are  viewed  as  positive 
traits.  It  is  plausible  that  women  in  such  work  environments  adopt  more 
masculine  identities  and  socially-desirable  masculine  characteristics  in  order 
to  succeed  as  leaders  or  aviators.  However,  some  women  have  strong  feminine 
identities  (developed  over  years  of  gender  role  socialization);  therefore, 
they  adopt  more  androgynous  identities. 

A  second  point  is  that  this  study  includes  only  female  aviators  who 
remain  in  the  Air  Force.  The  rigors  of  a  military  lifestyle  may  have  driven 
out  women  with  lower  self-esteem  (as  associated  with  feminine  and 
undifferentiated  gender  identities).  Furthermore,  the  military  environment 
promotes  masculine  behaviors  and  attitudes,  conducive  to  women  with  masculine 
or  androgynous  identities  versus  feminine  or  undifferentiated  identities.  It 
may  be  argued  as  well  that  some  wamen  with  high  self-esteem  (as  associated 
with  masculine  and  androgynous  gender  identities)  may  have  separated  from  t.ne 
Air  Force  after  they  experienced  sexism,  career  disappointments,  or  family 
conflicts.  Howeve.",  we  can  only  survey  the  female  aviators  who  remain  in  the 
Air  Force. 

A  third  explariation  may  be  that  the  military  and  aviation  attracts  women 
with  uncor.ventional  gender  identities.  Women  who  choose  flying  as  an 
occupation  may  be  mors  masculine  in  their  orientations  and  interests. 
However,  without  Longitudinal  data  (i.e,,  a  measure  of  women'.s  gender  identity 
cefore  their  entry  and  during  their  stay  in  the  Air  Force),  there  is  no  way  to 


’{jeteroice  if  wo^en  tiave  cere  siascuiine  or  anarogynous  identitiei;  prior  to 
jnilitary  scciaiizatior.. 

k  fourth  Interpretation  cay  be  that  feaaie  aviators  initaliy  have 
stronger  feminine  identities,  but  alter  their  gender  identities  to  cenfonn  to 
masouline  ouiture,  aspeeially  in  the  flying  world,  if  gender-role 
sooiaiization  is  a  lifelong  process,  gender  identity  can  change.  'Two  previous 
studies  say  support  this  assertion.  DeFleur  and  Warner  (193?)  found  that  49 
percent  of  USAFA  feisale  cadets  had  feminine  identities.  Some  of  these  women 
becaae  officers  and  aviators  and  may  be  participants  in  this  study.  In 
oQffiparing  tnis  study  with  DsFieur  and  Warner,  there  appears  to  be  a  shift  from 
feoiaine  identities  toward  masculine  and  androgynous  identities  for  female 
officers,  and  more  masculine  identities  for  female  aviators.  Furthermore,  in 
comparing  Bunivin  (1988)  ar.d  this  study,  there  appears  to  be  a  transition  fro.m 
androgynous  identities  of  female  officers  to  masculine  identities  for  female 
aviators.  It  is  plausible  that  as  female  aviators  adjust  to  the  flying  world 
they  adopt  a  more  masculine  identity  which  is  fostered  among  aviators.  Again, 
orily  longitudinal  data  can  determine  whether  women  change  their  gender  during 
their  military  careers. 


Conclusions 

In  comparison  to  women  in  general,  Air  Force  female  aviators  have 
nontraditicnal  gender  identities.  However,  the  flying  world  promotes 

masculinity,  and  the  women  may  acquire  a  masculine  identity  or  blend  their 
gender  identity  to  adopt:  an  androgynous  identity  in  order  to  succeed. 
Ccnsequently ,  the  women  place  less  importance  on  their  feminine  identity  in 
order  to  survive  and  thrive  in  a  masculine  culture. 

These  patterns  malce  sense  If  we  recognize  that  workers  (male  or  female) 
are  sodtaiized  to  accept  the  organization's  values  and  standards.  If  the 
military  primarily  promotes  masculine  vadues,  behaviors  and  attitudes,  female 
members  must  adopt  such  values  and  standards  in  order  to  work  and  build 
successful  careers. 

However,  there  remains  the  question  whether  women  should  adjust  to  the 
Air  Force's  male  world,  particularly  in  aviation.  Or  should  the  culture 
reflect  its  pluralistic  composition?  Some  contend  that  the  culture  should 
re^‘lect  the  organization's  purposes,  not  its  racial,  sex,  or  social 
ucoposition.  Others  argue  that  women  should  not  have  to  become  like  men  in 
order  to  be  accorded  the  privileges  of  the  rcale  world.  Instead,  there  should 
be  greater  recognition  for  women's  values,  cultures,  and  forms  of  behavior, 
all  of  which  contribute  to  our  nation's  defease.  This  difference  in  opinion 
will  continue  to  make  the  integration  of  women  into  the  military  a  problematic 
process. 
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Demographic  and  Attltudinal  Correlates 
of  Women’s  Role  in  the  Military 

Michael  D.  Matthews 
Drury  College 

Charles  K.  Weaver 
St.  Mary's  University 

Abstract 

This  paper  presents  data  on  American's  attitudes  toward 
women's  roles  in  the  military  as  a  function  of  several  variables. 

The  data  for  this  study  come  from  the  1982  General  Social  Surveys , 
conducted  by  the  National  Opinion  Research  Center.  The  criterion 
variable  required  respondents  to  indicate  whether  women  "should" 
or  "should  not"  serve  in  the  following  military  jobs:  nurse  in  a 
combat  zone,  typist  in  the  Pentagonj  commander  of  a  military 
installation,  truck  mechanic,  jet  transport  pilot,  jet  fighter 
pilot,  anti-aircraft  gunner  in  the  United  States,  hand-to-hand 
combat  soldier,  and  crew  member  on  a  combat  ship.  Four  predictor 
variables  were  examined:  age,  occupation,  perceived  relative 
financial  standing,  and  education.  In  general,  the  results 
indicated  that  younger,  more  highly  educated  respondents  who  are 
employed  in  white  collar  jobs  and  perceive  themselves  to  be  above 
average  in  financial  standing  were  signf ioantly  more  supportive  of 
women’s  participation  in  all  military  roles  examined.  These  effects 
were  most  pronounced  for  nontradltional  jobs  such  as  jet  fighter 
pilot  and  hand-to-hand  combat  soldier.  Implications  for  the  future 
role  of  women  in  the  all  volunteer  force  or  a  draft-based  force 
are  discussed  and  policy  ramifications  examined. 

During  the  recent  invasion  of  Panama,  Army  Captain  Linda  Bray  became  the 
first  woman  to  lead  troops  into  modern  combat.  This  action  was  widely 
reported  by  the  media  including  an  interview  with  Captain  Bray  on  NBC's  Today 
program,  and  coverage  in  major  papers  and  news  magazines.  As  pointed  out  in 
Time  magazine  (January  15,  1990,  p.  29)  the  actions  of  Bray's  platoon 
"rekindled  a  debate  over  whether  women  should  be  on  the  firing  line." 


One  factor  which  bears  on  the  Integration  of  women  into  military  roles 
concerns  public  attitudes  toward  such  integration.  If  Americans  express  a 
favorable  attitude  toward  women  assuming  combat  roles,  for  example,  political 
barriers  to  their  full  integration  are  lowered.  Davis,  Lauby,  and  Sheatsl-jy 
(1983),  examining  national  survey  data  which  addressed  this  question, 
concluded  that  "Americans  are  not  for  total  equality  of  the  sexes  in  the 
military,"  but  are  in  favor  of  a  greater  participation  of  women  in  the 
military  than  may  be  generally  recognized.  Matthews,  Melton,  &  Weaver  (1988) 
analyzed  the  5^une  data  base  by  Davis  et  al.  (1983)  and  found  that  the 
attitudes  of  Americans  toward  women's  roles  in  the  military  are  significantly 
affected  by  the  respondent's  race  and  gender,  with  women  being  more 
supportive  of  women's  participation  in  diverse  and  nontraditional  roles  than 
men,  and  blacks  being  generally  less  supportive  of  women's  participation  in 


77 


^ny  cilitary  role  chan  whites. 

The  purpose  of  the  current  study  was  to  further  examine  the  attitudes 
of  Americans  toward  women’s  roles  in  the  military  as  a  function  of  other 
demographic  and  attitudinal  variables,  liore  specifically,  the  current  study 
exami-'ad  support  for  women's  participation  in  military  roles  as  a  function 
of  age,  education,  perceived  relative  financial  standing,  and  occupation. 

The  data  base  that  was  used  in  the  earlier  study  by  Matthews  et  al.  (1988) 
was  also  used  in  the  current  study. 

Method 

Responses  from  1844  participants  in  the  1982  General  Social  Survey  (GSS) 
conducted  by  the  National  Opinion  Research  Center  provided  the  data  base  for 
the  current  study.  The  GSS  involves  face-to-face  interviews  of  a  national 
sample  of  United  States  citizens  age  18  and  over.  Respondents  are  selected 
randomly,  and  the  sample  is  stratified  to  insure  representative  sampling  of 
major  demographic  groups.  The  GSS  poses  over  300  questions  to  each 
respondent  on  a  wide  variety  of  topics. 

In  the  1932  GSS,  respondents  were  asked  to  indicate  whether  a  woman 
"should"  or  "should  not"  be  allowed  to  serve  in  the  following  military  roles: 
nurse  in  combat  zone,  typist  in  the  Pentagon,  commander  of  a  military 
Installation,  truck  mechanic,  jet  transport  pilot,  jet  fighter  pilot,  anti¬ 
aircraft  gunner  in  the  United  States,  hand-to-hand  combat  soldier,  and  crew 
member  on  a  combat  ship.  These  jobs  provide  a  mix  of  traditional  and 
nontraditional  roles  for  women  in  the  military. 

Responses  to  these  questions  were  crosstabulated  with  (1)  the 
••espondent’ s  age  (18-29,  30-49,  and  50-89),  occupation  (white  collar  or  blue 
collar),  education  level  (less  than  high  school,  high  school,  or  greater  than 
high  school),  and  perceived  relative  financial  standing  (lower  than  average, 
average,  or  higher  than  average).  Estimates  of  statistical  significance  were 
made  using  Chi  Square,  and  an  alpha  level  of  .05  was  selected. 

Results  and  Discussion 

The  main  findings  of  the  study  are  summarized  in  Table  1,  which  shows 
the  percentage  of  respondents  who  indicated  that  women  "should"  be  allowed 
to  serve  in  each  of  nine  military  roles  as  a  function  of  each  of  the 
predictor  variables.  With  respect  to  respondent's  education  level,  a  clear 
trend  toward  favorable  attitudes  coward  women's  full  participation  in  all 
military  roles  was  found  as  education  level  rose.  Respondents  with  less 
than  a  high  school  education  uniformly  showed  the  least  support,  ranging 
from  25.5  percent  who  indicated  that  women  should  serve  in  hand-to-hand 
combat  roles,  to  91.3  percent  supporting  women  serving  as  typists  in  the 
Pentagon.  Similarly,  respondents  with  more  than  a  high  school  education 
showed  the  strongest  support,  ranging  from  41.9  percent  who  indicated  women 
should  serve  in  hand-to-hand  combat,  to  98.8  percent  favoring  women  serving 

statistical  significance. 
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Substantial  and  consistent  findings  were  also  observed  as  a  function  of 
occupation.  White  collar  workers  clearly  were  more  supportive  of  women 
serving  in  ail  roles  examined.  Again,  all  comnarisons  were  statistically 
significant. 

With  respect  to  age,  younger  respondents  proved  to  be  more  supportive  of 
women's  involvement  in  military  roles  than  older  people.  As  a  rule,  small 
differences  were  noted  between  respondents  18-29  and  30-49  years  of  age. 
However,  in  comparison  to  the  responses  of  older  (age  50-89)  respondents, 
large  differences  were  found,  especially  for  nontraditional  roles.  For 
Instance,  only  20.7  respondents  age  50  or  older  favored  women's 
participation  in  hand-to-hand  combat,  compared  to  42.8  and  40.6  percent  for 
those  ages  18-29  and  30-49,  respectively.  Among  these  comparisons, 
significant  differences  were  found  for  all  roles  except  for  nurse  iu  a  combat 
zone . 

Finally,  the  relationship  between  perceived  relative  financial  standing 
and  attitude  toward  women's  roles  in  the  military  showed  a  consistent  pattern 
of  more  favorable  responses  with  increasing  level  of  financial  standing. 

This  held  true  for  each  role  considered  except  for  hand-to-hand  combat 
soldier,  where  no  significant  differences  were  found  as  a  function  of 
perceived  financial  standing.  All  other  comparisons  were  statistically 
significant . 

One  aspect  of  Che  findings  from  this  study  which  are  not  presented  in 
Table  1  due  to  space  restrictions  is  that  very  few  respondents  were  unsure 

of  their  opinions  on  these  questions.  Of  99  comparisons  made,  in  no  case 

did  more  chan  8  percent  of  the  sample  indicate  "not  sure,"  and  in  92  of 
the  comparisons  the  percentage  of  "not  sure"  responses  was  less  than  5 
percent.  This  held  true  even  for  nontraditional  roles,  such  as  hand-to-hand 
combat  soldier,  crew  member  on  a  combat  ship,  and  jet  fighter  pilot. 
Apparently,  most  Americans  have  a  firm  opinion  on  these  questions. 

It  is  also  interesting  to  note  that  the  least  support  was  given  for  the 
role  of  hand-to-hand  combat  soldier,  with  only  33.4  percent  of  respondents 

overall  favoring  women's  participation  in  this  role.  The  lack  of  support 

shown  by  the  public  for  this  role  is  surprising  given  that  the  majority  of 
respondents  favored  women's  participation  in  other  combat  and  combat- 
related  roles.  For  example,  the  overall  percentage  of  respondents  indicating 
that  women  should  participate  in  the  roles  of  crew  member  on  combat  ship, 
air  defense  gunner,  and  Jet  fighter  pilot  were  54.0,  54.2,  and  58.7 
respectively.  For  nurse  in  a  combat  zone  and  jet  transport  pilot,  both  of 
which  are  jobs  that  may  be  extremely  dangerous  in  modem  warfare,  the 
overall  approval  rates  were  90.8  and  68.7  percent,  respectively.  One 
wonders  if  Americans  have  an  accurate  view  of  the  nature  of  the  perils  of 
modern  warfare,  given  the  responses  of  the  subjects  of  this  study. 

One  interpretation  of  the  results  is  that  Americans  base  their  opinion 
on  raw  physical  requirements  of  various  roles,  and  in  terms  of  direct 
contact  with  the  enemy.  Thus,  the  role  of  hand-to-haud  combat  soldier  is 
viewed  as  inappropriate  for  women  by  a  majority  of  Americans.  In  contrast, 
the' role  of  fighter  pilot,  which  may  be  equally  dangerous,  is  viewed  as 
more  appropriate  for  women  because  of  less  direct  (face-to-face)  contact 
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with  the  enemy  and  lesser  physical  demands  placed  on  the  pilot  of  modem 
aircraft.  Consistent  with  this  analysis,  the  role  of  typist  in  the 
Pentagon  received  the  greatest  approval  by  the  respondents.  It  is  also  a 
low  demanding  job  physically  and  is  a  great  distance  from  enemy  personnel. 

One  other  dimension  of  the  current  data  requires  cosment.  The  role  of 
military  commander  received  mixed  support.  Overall,  56.0  percent  of 
respondents  indicated  that  women  should  be  in  command  of  a  military 
installation.  This  figure  compares  to  those  of  some  combat  roles,  such  as 
fighter  pilot.  This  is,  of  course,  a  nontradltional  role  for  a  woman  in 
OUT  society.  Because  support  for  this  role  was  the  same  or  smaller  than 
other  combat-related  roles  (e.g.,  nurse  In  a  combat  zone),  it  is  possible 
that  mere  danger  to  the  woman  from  the  enemy  does  not  explain  all  of  the 
findings.  One  might  h3rpothcsl2e  that  the  greater  the  deviation  of  a  role 
from  cultural  stereotypes,  the  less  the  support  for  it.  So,  protective 
paternalism  may  not  be  the  only  factor  In  interpreting  the  results  found 
in  this  study. 

It  is  clear  from  the  current  data  that  a  number  of  variables  modified 
the  respondent's  attitudes  towards  women's  roles  in  the  military. 

Education,  age,  occupation  and  perceived  financial  standing  (and  presumably 
other  variables)  affect  how  one  views  this  issue.  Information  of  this  sort 
shoudl  be  of  value  to  policy  makers  and  planners  in  building  support  for 
changes  in  personnel  policy  relating  to  women's  roles  in  thr.  military. 

They  also  have  implications  for  recruiting  and  human  resource  projections. 
If,  for  example,  the  applicant  pool  for  the  Army  is  heavily  represented  by 
poor,  relatively  uneducated  persons  from  blue  collar  backgrounds,  then  a 
change  in  Army  policy  regarding  utilization  of  women  in  combat  roles  might 
Impact  recruiting.  A  woman  interested  in  joining  the  Army  might  decide 
not  to  apply  if  she  felt  likely  to  be  placed  into  a  role  that  she  and  her 
friends  and  family  feel  is  inappropriate  for  women.  The  possible  effects 
of  policy  changes  on  recruitment  need  to  be  examined  systematically. 

Returning  to  the  case  of  Captain  Bray,  one  would  conclude  from  the 
current  study  that  the  majority  of  Americans  favor  an  expansion  of 
military  roles  open  to  her  and  other  women,  but  are  not  at  this  point 
ready  to  accept  women  in  hand-to-hand  combat  actions.  The  dynamics  behind 
these  attitudes  are  worthy  of  In-depth  and  systematic  examination,  and  the 
raislficatlons  of  future  policy  changes  must  be  explored  in  light  of 
effects  they  may  have  on  other  military  programs  and  operations. 
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Modifying  the  USAFA  BC?  Program  to 
Seduce  Gender  Biscriminaticn  Among  Basic  Cadets 

Cynthia  A.  'rfright 

“In  leadership,  there  appears  to  be  a  continuing 
relationship  between  physical  performance  and  leadership 
ratings  for  women. . .Women  who  do  net  perform  well  on 
physical  performance  measures  typically  receive  lower 
ratings  in  leadership  hj'  the  men." 

--Kaj  Jerome  Adams,  1979 

Aba  tract 

The  Basic  Cadet  Training  program  (ECT)  is  designed 
to  teach  military  skills  and  discipline,  strengthen 
leadership  and  followership  skills,  develop  physical 
fitness,  and  foster  a  spirit  of  teamwork  and  conraderie 
while  enhancing  self-confidence.  In  order  to  accomp¬ 
lish  all  of  these  objectives,  the  program  must  be 
physically  strenuous  as  well  as  mentally  challenging, 
and  yet  be  well  within  the  abilities  of  most  individ¬ 
uals  so  that  all  can  have  a  reasonable  expectation  of 
being  able  to  excel  through  their  own  efforts.  As  it 
is  presently  administered,  the  USAFA.  BCT  program 
seriously  hinders  the  development  of  leadership  skills, 
teamwork,  and  self-confidence  in  female  basic  cadets 
because  of  its  overemphasis  on  specific  physical 
activities  which  do  not  allow  recognition  of  overall 
physical  conditioning  or  mental  aptitude.  Hodifica- 
tions  of  the  BCT  conditioning  and  intramural  programs 
and  the  addition  of  more  non-physical  evaluations  and 
activities  are  recommended  in  order  to  lessen  the 
gender  bias  that  currently  exists  at  USAFA. 

When,  on  the  first  day  of  basic  training,  cadets  find 
themselves  rather  dramatically  separated  from  their  civilian 
lives  and  relationships,  they  immediately  begin  to  replace 
those  ties  by  establishing  their  social  place  in  the 
unfamiliar  environment.  Their  evaluations  of  one  another  in 
the  first  couple  of  weeks  have  a  considerable  effect  on 
their  lasting  imp  .'ess ions  of  relative  leadership  potential 
and  of  each  ind.vidual's  ability  to  contribute  to  the 
effectiveness  of  ihe  unit  as  a  whole.  Although  much  of  the 
training  is  necejsarily  physical,  it  tends  to  focus  very 
narrowly  on  thosf.'  activities  in  which  most  men,  with  their 
generally  greater  sise  and  upper-body  strength,  are 
inherently  more  adept  than  the  majority  of  women  As 

indicated  in  Adams'  statement  above,  based  on  his 

observations  of  male  and  female  cadets  at  West  Point,  tne 
females'  perceived  leadership  abilities  are  considerably 
decreased  by  their  general  inability  to  perform  as  well  as 
their  male  peers  on  these  few  exercises,  especially  running. 
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The  emphasis  on  skills  in  vhich  females  typically  do 
not  excel  creates  a  general  image  of  women  as  liabilities, 
rather  than  assets,  to  any  group  or  team.  According  to 
Priest,  Prince,  Rhone,  and  Vitters  (1977),  ’’P.elatively  few 
women,  not  more  than  1% ,  exceed  the  male  thirty-third 
percentile  standard.  This  means  there  is  little  overlap  in 
heiwght,  weight,  or  physical  aptitude  measures  of  the 
genders."  Despite  the  fact  that  an  average  woman's 
inability  to  match  a  particular  physical  feat  performed  by 
an  average  man  is  not  necessarily  an  indication  of  her 
relative  fitness,  "a  large  minority  of  men... want  equal 
treatment  with  n_o  exceptions"  (Priest,  et  al.,  1977).  This 
attitude  fosters  the  emergence  of  an  informal  leadership 
heirarchy  based  almost  exclusively  on  physical  aptitude  in 
activities  at  which  men  typically  excel. 

Greeno  (1989)  argues  that,  in  education,  individuals' 
personal  epistemologies  reflect  norms  (such  as  the  bases  for 
determining  leadership  potential).  These  normative 
perceptions  in  turn  profoundly  affect  group  members' 
aquisition  of  skills.  The  establishment  of  leadership  roles 
during  BCT  is  based  partially  on  the  traditional  gender 
roles  predomineut  in  the  backgrounds  of  many  cadets, 
especially  males--  women  at  USAFA  are  less  likely  to  reflect 
traditional  sex-role  socialization,  since  attending  a 
military  academy  is  generally  considered  to  be  inconsistent 
with  expected  "feminine"  behavior.  The  insistence  on 
physical  performance  as  the  primary  indicator  of  overall 
leadership  ability  creates  an  environment  in  which  men  will 
naturally  be  more  likely  than  women  to  achieve  traditionally 
masculine  leadership  roles.  ¥omen  who  conform  to  the 
imposed  norms  out  of  a  need  to  belong  to  the  group  are  less 
inclined  to  seek  out  opportunities  for  leadership  because 
doing  80  would  force  them  to  act  contrary  to  the 
expectations  of  their  predominently-nale  peers. 

The  male  basics'  initial  perceptions  of  women  as 
generally  inferior  because  of  their  physical  aptitude  often 
carry  over  inappropriately  to  the  fourthclass  year,  in  which 
athletic  performance  should  be  largely  replaced  by  academic 
and  military  performance  as  the  criteria  for  leadership. 
This  perceptual  set,  based  on  first  impressions,  may  prevent 
female  cadets  from  being  able  to  adequately  establish 
themselves  as  equally  contributive  members  of  their  unit 
even  if  they  excel  in  all  non-physical  aspects  of  training 
during  the  academic  year.  The  lack  of  recognition  for  their 
leadership  abilities  as  measured  by  academic  or  military 
performance  is  damaging  not  only  to  the  women's  self-esteem, 
but  also  to  the  overall  effectiveness  and  comraderie  of  the 
group  or  squadron  as  well. 

In  order  to  provide  for  a  greater  equality  of  treatment 
both  during  and  after  BCT,  moail'ications  should  be  made  to 
the  training  program  which  allow  cadets  to  compete  in  non¬ 
gender-specific  activities.  The  first  recommended  change  is 
the  elimination  of  the  morning  physical  conditioning  (PC) 
run.  According  to  Adams  (l979),  "Women  continue  tc  fall  out 
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of  the  runs  in  greeter  nunbers  than  do  the  sen  in  Cadet 
Basic  Training."  This  tendency  still  lenifests  itself 

today.  Sot  only  are  most  fenale  cadets  at  a  severe 
disadvantage  in  an  activity  which  is  largely  affected  by 
height  (and  corresponding  length  of  leg),  but  more  females 
suffer  running-related  injuries  than  dc  men  because  of  the 
additional  stress  placed  on  knees  and  ankles  by  wider  hips. 
Females  comprised  only  10?  to  12.5?  percent  of  their 
respective  incoming  classes  from  1987  to  1989,  yet 
statistics  from  the  USAFA  Cadet  Clinic  indicate  that  32.6? 
of  the  leg,  knee,  and  ankle  injuries  reported  by  basic 
cadets  during  those  years  were  experienced  by  women. 

Another  area  in  which  modifications  could  be  nade  is 
daily  intramurals.  Since  3CT  intramurals  are  designed  to 
promote  leadership  in  a  team  format  as  well  as  promote 
physical  conditioning,  the  program  should  be  reevaluated  in 
terms  of  creating  equal  opportunities  for  women,  and  men 
with  less  athletic  prowess,  to  excel.  Priest  (l977) 
suggests  that  “intramural  competition  could  serve  such  a 
purpose  (.developing  more  positive  conditions  for  intergroup 
contact]  if  it  were  organized  to  emphasize  skills  in  which 
women  are  the  equal  of  men."  Since  there  are  few  athletic 
events  in  which  women  and  men  are  equally  proficient,  one 
solution  would  be  the  implementation  of  a  rotating  schedule 
in  which  elements  or  flights  would  participate  in  a 
different  sport  every  week.  Currently,  intramural  teams  are 
chosen  at  the  beginning  of  BCT  for  such  team  sports  as 
flickerball  and  basketball.  These  teams  remain  constant, 
and  compete  in  their  sport  every  afternoon  during  the  first 
three  weeks  of  SCT.  A  rotating  schedule  would  allow  the 
elements  or  flights  to  participate,  either  as  a  team  or 
simply  a  group,  in  several  different  activities,  such  as  the 
usual  team  sports,  aerobic  workouts,  cross  country, 
swimming,  etc. 

Although  men  would  continue  to  excel  in  certain  areas, 
the  addition  of  activities  in  v;hioh  women  arc  traditionally 
more  adept  (such  as  aerobics),  and  in  which  neither  gender 
necessarily  has  an  advantage  (such  au  swimming  or 
volleyball),  would  allow  recognition  of  nore  diverse 
physical  skills  than  those  allowed  by  the  present  program. 
This  has  the  double  advantage  of  promoting  teamwork  among 
the  group,  since  elements  or  flights  would  not  be  split 
among  different  teams,  and  of  continuing  to  aulow  individual 
leaders  to  emerge  in  each  athletic  endeavor. 

Adams'  (l979)  recommendations  suggest  a  final 
modification  to  the  physical  training  environmen*. ,  focused 
on  the  cadre,  rather  than  on  the  basic  cadets  themselves: 

More  time  needs  to  be  set  aside  in  the  cadet  cadre 
preparaliou  training  to  allow  the  Cadcta  to  j-earn 
more  about  the  physiological  differences  which  account 
for  physical  performance  differences  between  men  and 
women  during  summer  t rai ni ng .  .  .  The  leadership  program 
should  devote  one  session  to  explain  that  physical 
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perf  0  rjaancc  j  especially  run  exercises,  is  net  the  only 

measure  of  a  cadet's  ability  to  lead. 

In  order  to  deeaphasize  the  powerful  informal  norsi 
which  recognizes  only  physical  standards  of  leadership,  a 
corresponding  increase  in  mental  and  military  evaluations 
should  be  implemented.  Priest,  et  al.  (1977),  point  cut 
that  "women  cadets  tend  to  have  achieved  greater  rank  in 
high  school  academic  subjects  than  men  cadets.  Without  a 
"job  analysis"  which  justifies  a  preference  for  certain 
traits  in. .. graduates ,  there  is  no  logical  basis  for 
preferring  physical  aptitude  over  mental  aptitude  in  a 
candidate."  The  generally  greater  military  and  academic 
achievements  by  women  are  substantiated  by  the  USAFA  Office 
of  Institutional  Heaearch  (1988),  which  notes  that  there  has 
consistently  been  a  greeter  percentage  of  firatclass  women 
than  men  on  the  Dean's,  Commandant's,  and  Superintendent's 
lists.  With  this  evidence  of  non-athletic  aptitudes  in 
mind ,  another  possible  modification  would  be  the 
restructuring  of  BCT  Field  Day  to  more  closely  correspond  to 
the  Sweepstakes  event  in  fiecognition  training  at  the  end  of 
the  fourthclaas  year.  Whereas  Field  Day  incorporates  only 
athletic  contests.  Sweepstakes  focuses  on  zhe  accomplishment 
by  small  groups  of  various  “obstacles , "  which  may  focus  on 
either  physical  challenges  or  military  knowledge.  A 
combination  of  the  two  measures  would  result  in  a  day  of 
general  competition  in  sports,  BCT  knowledge  from  Contrails , 
and  military  drill,  all  of  which  are  significant  parts  of 
basic  training.  Such  aq.uadron  competition  would  place  equal 
responsibility  for  winning  or  losing  upon  those  who  excel 
physically,  mentally,  and  militarily. 

A  means  of  discovering  and  developing  the  various  non¬ 
physical  leaders  prior  to  the  actual  Field  Day  competition 
might  include  constant  competitions  within  the  squadrons  in 
every  area  of  military  training.  The  top  performers  in  each 
area,  such  as  memorizing  quotes  and  knowledge,  shoe-shining, 
bed-making,  or  rifle  drill  would  train  several  of  their 
peers  who  are  moderately  skilled  in  the  same  area.  Each 
team  would  then  be  responsible  for  tutoring  the  rest  of 
their  classmates  in  their  area  of  specialization  during 
element  leader  blocks.  Sot  only  would  such  a  program 
increase  the  overall  skill  levels  within  the  squadron,  but 
it  would  also  help  increase  teamwork,  develop  leadership 
skills,  and  promote  class  unity  in  terms  of  the  entire  group 
being  responsible  for  each  member. 

As  the  nature  of  warfare  continues  to  shift  toward 
reliance  cn  technological  weaponry,  rather  than  the 
traditional  hand-to-hand  combat,  the  potential  for 
significant  contributions  by  women,  eepecially  as  members  of 
heterogeneous  problem-solving  groups,  will  increase 
dramatically.  If  sexism  is  to  be  reduced  throughout  the 
cadet  wing  and  the  Air  Fores  in  order  to  best  utilize  women 
as  a  vital  resource,  the  process  nuat  start  with  the  BCT 
cadre  and  with  the  basic  cadets.  Because  many  cadets. 
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e3peci£iiy  nales,  coee  froa  faicilies  with  traditional  values 
in  teras  cf  gender  roles,  and  Decauae  their  initial 
iffipressiens  of  their  peers  freouently  affect  future 
evaluations  of  individual  leadership  potential-- 
particulariy  that  of  wcoen  —  basic  cadets'  initial  training 
should  stress  non-gender  specific  aptitudes  in  as  aany 
different  areas  as  possible  during  their  indoctrination  into 
a  military  career. 
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Kotion  Sickness  Prevention: 

A  Course  of  Instruction  in  Cognitive -Behavioral  Counseling^ 
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tfciversity  of  New  Orleans 

Abstract 

This  paper  concerns  the  evaluation  of  a  program  of  5.nstruction  aimed 
at  training  individuals  to  counsel  clients  who  are  prone  to  motion 
siclcness.  Unselected  volunteers  were  offered  a  course  of  instruction 
reviewing  the  cognitive -behavioral  approach  to  help  personnel  tolerate 
motion  environments  without  developing  motion  sickness.  The  metliOds 
of  presentation,  content  and  assessment  of  knowledge  gained  are 
described.  Eleven  participants  of  that  course  were  subsequently 
available  to  independently  counsel  clients  who  were  prone  to  motion 
sickness,  using  the  cognitive -behavioral  approach  with  the  aid  of 
reinforcement  by  visually- induced  apparent  motion.  The  clients  were 
pre-  and  posttested  by  an  independent  observer  using  tolerance  and 
motion  response  as  the  dependent  variables.  These  test  scores  were 
compared  to  previous  data  obtained  with  clients  who  had  received 
counseling  from  an  experienced  counselor,  or  had  received  no  s\ich 
counseling.  Tne  results  indicated  that  the  newly  trained  counselor's 
clients  showed  significantly  Increased  pre-  to  posttest  tolerance  to 
the  motion  stimulus ,  although  they  did  not  benefit  as  much  as  clients 
trained  by  the  experienced  counselor.  In  addition,  however,  the 
trainee's  clients  exhibited  as  much  benefit,  in  terms  of  posttest 
symptomatology  as  did  those  of  the  experienced  counselor.  These  data 
are  taken  as  strong  support  for  the  feasibility  of  training  counselors 
CO  employ  this  method  of  alleviating  motion  sickness. 

The  term  motion  sickness  refers  to  a  cluster  of  signs  and  symptoms 
observed  in  individuals  during  or  shortly  after  experiences  in  some  motion 
environments .  The  etiology  of  this  syndrome  has  been  the  focus  of  numerous 
reports  (Money,  1970;  Reason  &  Brand,  1975;  Muir,  1983;  Benson,  1984)  acc  is 
generally  considered  to  be  associated  with  disorientation  which  results  froui 
the  inablllcy  of  the  human  sensory  apparatus  to  contend  with  motion 
environments  provided  by  modem  transportation.  More  specifically,  it  is  felt 
that  motion  sickness  comes  about  because  of  e  mismatch  in  Che  sensory  inputs 
during  motion  (Benson,  1984;  Oman,  1982;  Reason,  1978;  Reason  &  Brand,  1975). 
Any  disruption  of  Che  natural  correlation  of  these  inputs ,  or  the  internal 
dynamic  model,  results  in  the  syndrome  of  autonomic  responses  commonly 
described  as  motion  sickness. 


^  The  opinions  and  interpretations  contained  herein  are  those  of  the 
authors  and  do  not  necessarily  reflect  the  views,  policies,  or  endorsements  of 
the  Department  of  the  Navy  or  any  other  government  agency. 


The  incidence  of  monion  sickness  is  difftcrult  to  determine,  since  it 
depends  on  the  strength,  characteristics ,  duration  of  notion  stiiruli  and  the 
individual's  previous  experiences  with  motion.  Some  vestibulax  physiologists 
contend  chat  niotion  sickness  is  reflexive  and  occurs  in  all  nomal  clients 
given  a  provocative  enough  taction  environiaent .  But  it  is  also  clear  that  soi&e 
individuals  are  more  susceptible  to  the  effects  of  motion  than  others.  One 
recent  view  suggests  that  some  of  the  individual  differences  derive  from 
attitudes  and  expectations  about  niotion  environments  formed  from  previous 
experiences  in  motion  laden  settings.  It  is  felt  that  anticipator^'  fears 
regarding  motion  environments  serv’e  to  exacerbate  the  reflexive  response  to 
disorienting  motion  and  render  the  individual  mere  prone  to  motion  sickness. 

If  this  view  is  correct,  it  suggests  that  one  approach  to  the  treatment  of 
motion  sickness  might  include  cognitive  inter'.’ention. 

In  a  recent  series  of  investigations  (Dobie  et  al.,1987;  Dobie  et  al . , 
1989) .  Dobie  and  coworkers  have  investigated  various  forms  of  treatment  aimed 
at  increasing  tolerance  to  motion  or  apparent  motion  experiences .  The  results 
of  these  studies  indicated  that  the  most  beneficial  treatment  involved 
counseling  which  sought  to  increase  an  individual's  confidence  in  their 
ability  to  tolerate  disorientation  during  motion,  coupled  with  controlled 
exposure  to  such  motion  to  reinforce  those  beliefs.  Since  previous 
experiments  have  involved  only  one  counselor,  a  concern  has  been  whether  or 
not  these  treatment  procedures  are  efficacious  in  the  hands  of  other 
individuals .  The  focus  of  the  present  study  was  to  develop  a  course  of 
instruction  which  provides  counseling  expertise  and  to  field-test  the  results 
of  such  iiiscruction  with  clients  prone  to  motion  sickness. 

Method 


Thirteen  individuals,  ten  civilians  and  three  Navy  personnel  were 
enrolled  in  a  12  session  course  of  instruction  on  motion  sickness  prevention. 
This  included  information  on  the  signs  and  symptoms  of  motion  sickness, 
etiology,  treatment,  and  prevention.  They  were  asked  to  read  Benson's  review 
article  and  a  series  of  articles  concerned  with  the  cognitive -behavioral 
method  of  training  tolerance  to  motion  environments  (see  references).  This 
approach  points  out  that  in  addition  to  the  normal  disorientation  and  anxie  ty 
experienced  in  some  motion  environments,  the  individual  approaches  such 
activities  with  attitudes,  memories  and  past  experiences  associated  with 
similar  motion  environments.  These  anticipatory  fear  reactions  can  exacerbate 
or  amplify  arousal  leading  to  increased  susceptibility  to  motion  sickness. 

The  aim  of  cognitive -behavioral  therapy  is  to  help  the  client  understand  this 
and  to  build  confidence  in  the  belief  chat  alleviating  the  negative  cognitive 
overlay  will  allow  them  to  tolerate  motion  environments.  Such  confidence  can 
be  strengthened  by  controlled,  incremental,  exposures  to  disorienting  motion 
or  pseudo-motion  environments.  The  theoretical  and  experimental  support  for 
the  feasibility  of  this  method  was  discussed  and  specific  case  histories  were 
reviewed.  A  fifty  item  multiple  choice  examination  was  administered  in  the 
last  session.  Grades  ranged  from  66  to  96  %  correct  with  a  mean  of  85.5  % 
and  a  standard  deviation  of  7.7  %. 
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Cli 


All  potential  clients  were  asked  to  fill  out  a  motion  history 
Questionnaire  and  a  medical  history  questionnaire  On  the  basis  of  this 
ihlcrraatton ,  clients  with  a  history  of  motion  sickness  and  no  medical  problems 
were  asked  to  \undergo  pretesting  as  described  below.  Those  clients  who's 
pretest  tolerance  sccre  was  less  than  8  min.  were  selected  and  assigned  to 
cijutiselors ,  They  ranged  in  age  from  17  to  53  years;  2  were  male  and  18  were 
female.  Clients  were  always  assigned  to  a  counselor  whom  they  had  not 
previously  mat.  Kiae  cf  the  eleven  cotinselors  were  assigned  two  clients  and 
the  two  remaining  counselors  were  assigned  only  one .  Thus ,  twenty  clients 
were  trsated  by  the  eleven  counselors. 

Tolerance  to  visually- induced  apparent  motion  was  used  as  a  dependent 
measure  and  as  a  means  to  reinforce  client's  confidence  regarding  their 
ability  to  fcolerste  disorientation.  The  device  was  a  circular  drum  five  feet 
in  diameter  and  four  feet  in  height  with  a  mirrored  ceiling.  The  inner 
surface  of  the  drum  was  lined  witli  alternating  black  and  white  vertical 
stripes,  six  inches  wide.  Client.?  sat  in  a  stationary  chair  while  the  drum 
rotated  aroiiad  them  at  10  rpm.  Vith  appropriate  fixation  the  entire  visual 
field  was  stiaulated  and  rotation  cf  the  drum  produced  a  compelling  illusion 
of  circular  self -motion. 

Prccedure 

Prior  to  treatment,  all  clients  completed  a  current  physical  station 
report  and,  before  and  after  stimulation,  a  symptom  checklist.  During  pretest, 
clients  were  instructed  to  indicate,  using  a  button  press,  when  they  first 
noticed  identifiable  motion  sickness  responses,  at  which  time  the  stisaulatior. 
would  cease.  Twenty  minutes  was  set  as  ths  limit  for  tolerance.  All  clients 
were  pre-  and  posttested  by  the  same  experimenter  who  was  not  one  of  the 
counselor  candidates.  The  posttest  was  Identical  to  the  pretest.  All 
counselors  were  instructed  to  employ  cognitive -behavioral  counseling  over  ten 
sessions.  They  were  invited  to  seek  clarification,  from  the  experienced 
counselor  or  the  principal  investigator,  if  th&y  had  any  questions  as  to  the 
procedures  to  be  employed.  No  assistance,  however,  would  be  provided  during  a 
counseling  session. 

RESULTS 

Measures  of  pre-  and  cost  treatment  tolerance  and  symptomatology  were 
tabled  for  the  twenty  clients  in  the  present  study,  together  with  eighteen 
clients  previously  treated  by  tl.s  experienced  counselor  and  eleven  nen- treated 
control  clients.  Each  measure  was  r-ubmitted  tc  a  two  factor,  aixed  analysis 
of  variance  design.  Subsequent  paired  comparisons  were  performev  vith  Newman- 
Keuls'  tests.  Significance  levals  were  sev;  at  p  <  0.01  for  all  effects. 

The  meari  tolerance  scores  zs  h  f’.u-cuicn  of  pre -posttesting  for  all  three 

<•  4  T*  f  ^  V  *.  4  ..  ^ .  -  v  -  ^  fc.l_  _  - 
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tolerance  cf  both  the  instructor's  and  the  trainee's  clients  increased 
considerably  relative  to  the  sesii  tolerance  cf  the  control  group.  However, 
the  instructor's  cliem-s  shoved  greater  benefits  uhaii  these  cf  the  tiiiinfeps. 
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Significant  main  effects  for  groups  and  prepost  were  obtained,  A  significant 
groups  by  prepost  interaction  was  also  obtained.  The  pretest  tolerance  score.s 
were  not  significantly  different,  nor  were  the  pre-  and  posttest  scores  for 
the  control  group.  All  other  paired  comparisons  were  significant. 


Figures  1  and  2.  Mean  tolerance  (left)  and  symptomatology  (right) 
scores  as  a  function  of  pre*  and  posttesting  for  clients  treated  by 
instructor  and  trainees,  together  with  untreated  control  subjects. 

The  mean  symptomatology  score  was  obtained  by  summing  the  difference  in 
symptoms  before  and  after  each  pre*  and  posCtest  for  each  individual,  to 
obtain  a  composite  score  for  each  test.  The  mean  symptomatology  scores  as  a 
function  of  pre-  and  posttesting  for  all  three  groups  are  presented  in  Figure 
2.  It  is  apparent  that  all  three  groups  exhibited  a  decline  in  symptoms,  but 
the  treated  groups  showed  a  greater  decline  than  did  the  controls.  A 
significant  main  effect  for  prepost,  but  not  for  groups  was  found.  A 
significant  groups  by  prepost  interaction  was  also  obtained.  The  mean  pretest 
symptomatology  scores  were  not  significantly  different,  nor  were  the  pre-  and 
posttesc  Bsaxis  for  the  control  group.  Significant  pre-post  meari  differences 
were  obtained  for  each  treated  group,  and  the  trainee  group's  posttest  was 
significantly  below  that  of  the  other  two  groups.  On  posttest  the  Instructor 
group's  mean  was  not  significantly  different  from  the  control  (probably  due  to 
a  poor  sampling  bitak  obtained  at  pretest). 

DISCUSSION 

These  results  clearly  support  the  feasibility  of  the  counseling  program 
and  offer  furthor  support  for  cognitive -behavioral  training  as  a  viable  method 
to  manage  motion  sickness.  Although  these  data  are  impressive,  numerous 
factors  should  be  considered  in  the  future  iaplfiiaentatlon  of  counselor 
training.  In  the  present  investigation,  we  made  no  attempt  to  select  trainees 
according  to  any  preset  criteria.  Thus,  our  training  program  was  a 
conservative  test  of  the  notion  that  such  skills  can  be  taught.  It  could  be 
expected  that  the  inclusion  of  numerous  selection  criteria  would  lead  to  even 
more  efficacious  training.  It  might  bo  useful  tc  explore  various  standardized 
tests  of  personality,  aptitvid?,  ability  and  schieveinent  as  selection  criteria. 
It  is  our  impression  that  an  assessment  of  potential  trainee's  confidence, 
interpersonal  skill,  maturity,  intelligence,  persuasiveness  and  optimism  are 
all  important.  While  standardized  tests  of  such  ability  may  not  be  available, 


90 


it  is  feasible  to  assume  that  these  characteristics  can  be  assesses  by 
interview . 

tthile  the  present  course  content  and  leethod  of  instruction  appear 
adequate,  some  modifications  might  prove  beneficial.  Some  trainees  suggested 
t^t  it  might  be  helpful  to  view  video  tapes  from  actual  counselor  sessions. 

Ve  recotasend  that  this  be  considered  for  Inclusion.  Ve  used  a  conventional 
lecture  format,  but  it  might  be  that  the  material  could  be  covered  equally 
well  with  program  instructional  media.  Thus,  self-study  programs  in  the  form 
of  programed  texts  or  computer  based.  Interactive  programs  should  be 
considered.  It  may  be  that  group  discussions  lead  by  an  experienced  counselor 
would  be  a  useful  adjunct  to  any  mode  of  instruction.  Finally,  it  is  highly 
recotamended  chat  a  period  of  supervised  counseling  be  added  to  the  future 
implementation  of  these  training  efforts. 

In  Che  present  investigation,  we  used  visually* induced  apparent  motion 
exposure  during  counseling  Co  reinforce  subject  confidence  in  their  ability  to 
cope  with  disorienting  environuents ,  but  the  apparatiAs  to  produce  such 
experience  may  not  be  readily  available.  Ve  are  presently  exploring  the 
possibility  of  using  other  modes  of  motion  to  produce  disorientation  (e.g. 
active  bodily  rotation),  which  may  prove  more  economical.  In  conclusion,  it 
is  apparent  chat  considerable  counseling  skill  can  be  imparted  to 
inexperienced  trainees  and  and  these  individuals  can  help  personnel  learn  to 
tolerate  provocative  motion  stimill.  This  has  important  implications  for  both 
military  and  civilian  populations  -  on  the  ground,  in  the  air  or  at  sea. 
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Abstract 

This  paper  outlines  an  investigation  of  the  relationship  of  behaviors  exhibited  in  a 
pre-flight  brief  with  subsequent  performance  in  a  mission  simulator.  Seven 
helicc^tei  crews  were  evaluated  on  their  Mission  Analysis.  Assertiveness.  Flexiiality, 
Situational  Awareness,  Leadership.  Decision  Making,  and  Communicanon,  during 
dte  prefiight  brief  and  subsequent  flight  OpcratitxuJ  behavics*  ratings  were  also  made 
for  the  simulated  flight  Leadership  pre-flight  Mefing  bshavic^  were  found  to  be 
related  to  Operational  ratings  and  to  the  Leadership  behaviors  observed  during 
simulated  flight  Decisum  Making  behaviors  displayed  during  the  pre-flight  brief 
were  positively  correlated  with  Decision  Making  behaviors  exhibited  during 
simulated  flight 

Over  a  decade  ago,  reseazchcis  r^xrrtcd  that  a  large  number  of  aircraft  incidents  and  accidents 
were  due  to  a  lack  of  decision-making,  leadership,  pilot  judgement  and  coordination  in  the 
cockpit  (Cotirer,  \V'hitc,  &  Lauber,  1980)  Since  that  time  civilian  and  military  aviation  experts 
have  worked  to  design  and  inclement  aircrew  coordination  training  (ACT)  programs  in  hopes  of 
avoiding  future  accidents  and  incidents.  However,  in  1987,  Hackman  noted  that  the  parameters  in 
which  the  crew  must  operate  are  largely  established  prim  to  tl^  crew's  first  meeting,  and  that  many 
ACT  programs  ignore  this  first  (and  possibly  most  crucial)  intaaction.  Ginnett  (1987)  reported 
that  during  tibc  first  few  minutes  of  the  pilot's  pre-flight  brief,  crew  members  can  reliably  assess 
whether  the  pilot  will  be  cffcctiv;  at  building  and  promoting  a  positive  working  environment  or 
not 

Ginnen's  (1987)  field  study  of  commercial  pilots  who  were  judged  by  their  peers  to  be  cither 
effective  or  ineffective  in  crew  coordinanon  revealed  specific  pre-flight  briefing  behaviors  that  were 
exhibited  by  effective  pilots.  A  listing  of  some  of  the  behaviors  identified  by  Ginnett  is  given  on 
the  left  side  of  Table  i.  On  the  right  side  of  Table  1  arc  behavioral  examples  of  effective  military 
coordmation  (Oser.  McCallum,  Salas,  &.  Morgan.  1989).  As  seen  in  Table  1 ,  although  the 
applications  differed  between  civilian  and  military  teams,  there  were  manj  similar  behaviors 
identified  by  these  independently  conducted  research  efforts.  The  Oser  ct.  aL  behaviors,  along 
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Tabic  1.  Contrast  of  Ginnett's  (1987)  Briefing  Behaviors 
and  Oscr,  et  al..  Military  Coordination  Behaviors 


Ginnett's  Briefing  Behaviors 

Engage  Odiers  in  Conversation 
Created  BtMnidar^ 

Provide  Rationale 

Seek  to  Undeistand/Not  Place  Blame 
Engage  Odiers  in  Brief 
Discuss  Coordinadon  Tasks 
Disavows  P«rfecti<» 

Tailffl’ Brief  to  Mission 


Oscx,  ct  al„  Behaviors 

Reply  with  QacstiOT/Commcnt 
Structure  Tasks,  Plans,  Objectives 
Provide  RatUHiale 
Provide  Feedback  on  Performance 
Ask  Fot  Input 

Veibaliae  Plans  for  Procechires 
Provide  Legitimate  Avenue  of  Dissent 
Question,  Seek  Data,  Iribimation,  Plans 


with  other  behaviors  identified  as  critical  to  aiioew  coonfinationpeifbniumct,  saved  as  a  v>a«c  for 
fisc  behavioral  skills  rating  instrument  used  in  this  study  (Franz,  Prince,  <^annon*Bowers,  and 
Salas,  1990). 

The  purpose  of  this  investigation  was  to  assess  the  relationship  of  pre-flight  briefing 
behaviors  with  subsequent  performance  in  a  full  motion  kelic<^ter  flight  simulator.  The  pre-flight 
brief  served  as  the  formation  and  orientation  period  for  each  crew.  A  written  outline  fer  the  brief 
was  followed  by  every  pilot,  as  required  by  regulations.  This  period  allowed  the  pilot  to 
disseminate  relevant  information  (e.  g.,  weather,  ceilings,  landing  zone  coordinates)  and  to 
verbalize  procedures  (e,g.,  transfer  of  flying  rntponstblities,  emezgouy  procedures,  etc.)  that  may 
be  required  during  the  mission.  It  was  expecred  that  observations  of  behavioral  examples  like 
those  in  T.ibie  1,  during  fire  preflight  brief,  would  be  associated  with  observed  aircrew 
coQfdinaticm  behavims  and  operational  ratings  in  a  -tiwiiilatgd  mission. 

Method 

Each  preflight  brief  was  Uqjc  recorded,  each  crew's  simulator  performance  was  video  taped, 
and  the  tapes  wo-e  subsequently  transcribed.  The  raters’  scores  were  based  on  these  transcripts. 
Raters  thoroughly  reviewed  the  transcripts,  and  then  independently  indicated  which  bchavior(s) 
were  di^layed  by  the  crew.  The  rater  then  assigned  a  numerical  score  for  each  crew  memher  on 
each  dimrarion  (0  »  Not  Observed,  1  =  Unsatisfactory,  2  *  Below  Average,  3  =  Average,  4  <= 
Above  Average  and  5»  Excellent).  The  prefUgbt  briefs  were  rated  on  seven  behavioral 
dimensions;  Decision  Making,  Assertiveness,  Flexibility,  Situational  Awareness,  Mission 
Analj^is,  Leadex^up,  and  Communication.  A  coefBciem  of  intc-rater  agreement  was  i~.alni!ytfr)  to 
quantify  the  amount  of  agreement  between  raters.  A  coefficient  for  overall  agreement  was 
calculated  at  (r  =  .76). 

Tiic  intuscripis  of  ihc  simulator  scenarios  were  rated  on  the  same  seven  a  safety 

officer  qualifed  to  rate  the  crews'  (^rational  performance  also  gave  operational  ratings  that  wwc 
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used  as  a  dependant  measure.  Cotrektions  were  then  computed  between  the  ratings  to  detemsine 
whether  prefiight  brief  behaviors  were  associated  with  aircrew  coordination  performance  and/or 
qperadonal  performance. 

Results 

As  seen  in  Table  2,  the  Leadership  behaviors  were  most  highly  correlated  with  the 
operadonal  performtuice  ratmgs.  That  is^  crews  that  addressed  tc^ic  areas  related  to  Leadership 
dunsg  the  prefiight  brief  received  higher  ratmgs  of  overall  task  performance.  Frequent  behavioral 
observatioas  within  this  dimension  included,  but  w^  not  limited  to:  the  pilot  asking  for  input  and 
discussing  potential  problems,  the  pilot  informing  crew  members  what  idiould  be  done,  and  the 
pikH  providing  the  oew  members  with  a  legitimate  avenue  of  dissent  to  voice  their  ccsicexns. 

Coirelaticms  of  the  preflight  briefings  with  the  Pilot  and  Co-pilots  behavioral  ratings  in  the 
full-mission  sitnulator  facilitated  an  examination  of  the  consistency  of  the  crews’  behaviors  from 
the  brief  to  the  mission.  As  indicated  in  Table  2,  Leadership  and  Dedsktn  Making  were  positively 
OMielated  on  theses  two  measures.  Leadership  behaviors  in  both  the  preflight  brief  and  the 
scenario  included  determining  ckady  the  tasks  to  be  assigned,  and  keeping  the  crew  focused  on  die 

Table  2.  Conelations  ( r )  of  Pre-Flight  Briefing  Behaviois 
with  C^)eratk)nal  Ratings  and  Crew  Coordination  Behaviors 


Pre-Briefing 

Dimension 

Operational 

Ratings 

Piloi  &  Co-Pilot 
Behavienns 

Pilot  Sim 
Behaviors 

Co-Pilot  Sim 
Behaviors 

Mission 

Analysis 

.37 

— 

— 

— 

Decision 

Making 

-.14 

.97* 

.77* 

— 

Assertiveness 

.48 

-.08 

-.33 

.94* 

Adaptability 

Flexibility 

— 

— 

— 

— 

Situational 

Awaxeness 

.21 

-.32 

-.32 

... 

Leadership 

.79* 

.91* 

— 

— - 

Communication 

.12 

-.09 

— 

-.19 

Note:  N=14.  *  p  <  .05.  —  insufficient  data 


ta^  «  hand.  Specific  Decision  Making  behaviors  consisted  of  members  gathering  information 
betbre  making  a  decision,  crew  numbers  cross  checking  information,  and  members  frequently 
identifying  aliem^ves  and  contingendes  available  to  than. 

The  last  two  columns  in  Table  2  provide  insight  to  the  specific  behavioral  dimeasions  relating 
to  the  preflight  briefing  performance  of  pilots  and  co-pilots.  The  extent  to  which  a  pilot  will 
display  effective  decision  making  behaviors  during  a  flight  was  associated  with  his  rating  on  the 
decisiem  malring  dimension  during  the  preflight  brief.  Pilots  who  initiate  effective  dedsuxi  making 
strategies,  tended  to  use  effective  decision  making  strategies  during  the  nussion  Tne  behaviors 
consistent  for  the  co-pilot  during  the  preflight  brief  and  during  the  mission  lay  in  the  assertiveness 
dimension.  Co-pilots  who  ffequentiy  asked  questions  when  uncertain,  made  suggestions,  stated 
opinions  and  ctmfroated  ambiguities  during  the  inflight  brief  were  also  assertive  during  the 
mission. 


Discussion 

Previous  independent  research  (Ginnett,  1987;  Oser,  McCallum,  Salas,  &  Morgan,  1989) 
has  revealed  comparable  behaviors  commonly  demonstrated  by  effective  crews  during  their  initial 
formation.  In  the  present  research,  the  results  indicated  that  a  qualified  military  aircrew's  behavior, 
as  observed  during  the  preflight  brief,  was  associated  with  their  operational  performance  ratings 
and  their  coordination  levels  in  tiie  cockpiL 

Ihe  findings  woe  sui^rortive  of  eaiiior  work  in  the  civilian  aviation  sector,  and  offer  prondse 
for  futtirc  research  of  the  aircrew  preflight  briefing  process.  As  expected,  the  crews  displayed 
vimations  in  preflight  Isiefing  behaviors  de^he  following  a  standard  checklist .  In  suimnary  these 
preliminaiy  results  suggest  that  several  relationships  exist  between  the  preflight  luief  and 
performance  in  the  cockpU.  Preflight  brief  behaviors  were  related  to:  (a)  operational  crew 
performance,  (b)  an  aircrew's  effectiveness  as  measired  by  the  dimeusions  of  Leadership  and 
Decision  Ms'dng.  (c)  a  pilot's  decision  making  effectiveness,  and  (d)  the  extent  to  whidi  a  co-pilot 
will  di^lay  effective  assertive  behavuHS  in  the  cockpit 
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This  gives  a  brief  outline  of  the  methodology  used  to  identify  and  categorize 

behaviors  used  as  a  basis  for  deveh^untmt  of  a  skill-based  aircrew  cocadination 
txamiDgpdmgramfarahelkqttercomtaaaity.  The  research  effort  began  in  1986  and 
encooq>asses  literature  reviews,  observations  of  lean  develo^lHnent,  interviews  of  job 
experts,  and  surveys  of  the  aviarion  community.  Thirty  seven  behaviors  were 
identified  and  catcgoiued  unto  the  dirnetsioas:  Mi^km  Analysis,  Dedsitm  Making, 
AssertivMiess,  Flexitality,  Situatianal  Avrazeness,  Communicadons,  and  Leadership. 

The  fact  that  aircraft  incidents  and  accidents  today  are  largely  caused  by  human  error  is 
ctm:q>dliagjustificatkmfinrtoiotioductioo<tfain»ewcDOfdinationtraining|Xi>grams.  While  eady 
aviators  were  plagued  with  accidents  caused  by  faulty  equipment  or  a  lack  of  "stick  and  rudder 
skills"  it  is  human  eiror  that  is  tibe  identified  cause  of  60-80%  of  all  incidents  and  aeddents  today 
(Carndl  and  Taggart.  1987).  These  human  einxrs  are  tan  to  to  a  lack  of  koowlolge  needed  to  fly 
the  aircraft,  but  from  dilutes  to  coordinate  the  resources  available  to  the  pilot,  particulaiiy,  the 
resources  of  the  fellow  crewmembers  (Lauber,  1987). 

Poor  crew  coordination  omipfomises  not  only  flight  safety  but  also  effective  mission 
performance.  Coofuskn  about  role  requirements  in  imn-rooanesiniatiGns,  the  failure  to  include  all 
crew  monbers  in  decisions  that  require  their  inputs,  and  a  lack  of  awareness  of  the  work  and 
information  needs  of  fellow  crew  members  can  reduce  the  effectiveness  of  crew  peifcrmancc. 
These  two  factors,  safety  and  perfonnance.  have  purred  a  new  eiiq>hasis  on  training  crews  for 
optimal  ooerdinatioa  in  the  cockpit 

Although  crew  coordinarion  training  is  important  for  all  aircrews,  it  is  of  particular 
importance  to  military  aviators.  The  nature  of  military  missioas.  with  their  potential  to  increased 
stress  and  workload,  makes  coordinated  actum  in  the  cockpit  even  more  critical  than  in  routine 
civilian  flying.  Military  aviator  training  must  be  designed  to  assure  the  acquisition  of  fee 
coordinarion  sldlls  needed  for  both  present  and  future  mission  requirements.  In  order  to  assure 
that  the  necessary  training  ocems,  the  idenrificarion  of  these  coordination  sldlk  is  required.  Once 
these  skills  are  idenrified,  qualitative  and  quantitative  measuiements  cri  their  occurrence  can  then  be 
used  to  validate  fee  use  of  a  skill-based  training  program. 


Tlic  aviation  iad:^;,'_~-  uzJ  the  military  have  developed  programs  that  attempt  to  meet  aircrew 
coordnatioo  trainiitg  needs.  However,  these  programs  var,'  in  their  approaches,  durarlon  of 
tmining,  in  identi^aiion  and  definition  of  necessary  skills,  ano  training  technology  used  (Jensen, 
19^).  Diversity  in  the  training  is  due  in  part  to  the  lack  of  validation  of  the  programs.  Despite  the 
importance  of  the  training  and  die  widespread  interest  in  the  programs,  both  by  those  in  air 
opemdais  and  tin  Federal  Aviation  Administratkui  (FAAX  their  effectiveness  in  in^noving  cockpit 
coordination  has  not  been  established  (Jensen,  1987;  Foushee,  1987). 

It  is  clear  at  presort  than  (1)  the  problem  of  human  interaction  for  the  safe  conduct  of  flight  is 
considered  serious  enough  that  it  must  be  addressed,  aid  (2)  the  elements  that  need  to  be  trained, 
as  well  as  the  most  effective  technology  to  be  used,  have  not  yet  been  determined.  It  is  the 
identification,  development,  and  evaluation  of  bthaviorally  based  crew  coordination  skills  that  is 
considered  primary  in  aircrew  coordination  training  programs.  The  focus  of  skill-based  aircrew 
coordination  training  is  behavior.  No  matter  what  the  theoretical  base  for  the  existing  programs, 
moa  of  them  refer  to  behaviorally-based  skills,  which  are  considered  in^>ottant  to  effeedve  cockpit 
management  One  researcher  has  pioneered  efforts  in  this  area.  Ginnett  (1988)  observed  airline 
esptains  who  exhibited  dramatic  behavioral  difierences  in  their  ability  to  build  and  maintain  teams. 
Ginneas  obsovadons  of  bdiavioral  differences  during  the  briefing  of  the  crew,  suggested  that 
these  behaviors  can  be  identified,  taught,  modeled  and  evaluated. 

Pan  of  the  failure  of  existing  aiioew  coordination  training  progranos  to  evaluate  training 
effectiveness  is  the  absence  of  a  means  for  measuring  the  effects  of  the  training.  It  is  important  that 
aircrew  oiordinadon  training  include  observable  elements  that  will  facilitate  evaluation.  This  p^)er 
outlines  the  process  of  identifying  bchavioraUy  based  crew  coordination  skills  for  a  military 
helicopter  community. 


Research  Foundation 

A  review  conducted  by  Morgan,  Glickman,  Woodward,  Blaiwes  and  Salas  (1986)  revealed  a 
listing  of  behaviors  that  were  expected  to  occur  dcring  the  formadon/evoiution  of  the  crew. 
Morgan  et  aL,  suggested  that  coordination  training  sliould  seek  to  improve  and  enhance  the  crews' 
ability  to  conanunicate,  relate,  and  interact  Furthermore  the  training  should  "generate  group 
cohesion  and  organizahonal  conmntment,  and  sustain  the  integrity  and  viability  of  the  team" 
regardless  of  the  situatuxial  circumstances  (p.  17-18). 

In  1986,  Morgan  ct  aL,  verified  that  these  bchaviOTS  ca  skills  are  needed  for  the  development 
of  effectively  functioning  crews.  Using  a  collection  of  aitical  behaviors  from  instructors  and  self 
reports  from  team  members,  Morgan  ct  aL.  identified  ninety  behaviors  charactcrisdc  of  crew 
development.  The  behaviors  were  categorized  into  seven  dimensions:  communication, 
coordination,  team  spirit  and  morale,  cooperation,  adaptability,  acceptance  of  suggcsiiops  or 
criticism,  and  giving  suggestions  or  criticism.  Morgan  et  al's.,  obscrvaiions  of  Naval  Gunnery' 
Crewi  revealed  that  these  dimensions  could  be  used  to  discriminate  between  effective  and 
ineffective  crews.  Effective  crews  exhibited  a  higher  number  of  critical  behaviors  in  each 
dimension,  and  their  prcccss  of  crew  development  could  be  observed  using  the  identified 
behaviors. 
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According  to  Morgan  et  al^  crew  coordination  training  needs  to  be  committed  to  those 
pcrson-io-pcKOn  activities  which  arc  designed  to  enhance  interpersonal  communications,  social 
leiiudoQshj^  interaction  patterns  (Le.  the  maintenaiu^  of  the  crew  as  a  cc^sive  unit).  As 
Morgan  et  aL,  hypothesized  (and  Glnnett  foond)  a  "substantial  poxiion  of  the  ciiergies  devoted  to 
buildiog  heaer  crews  can  be  accountoi  for  in  terms  of  activities  titat  are  aimed  at  people  (he.,  other 
team menobezs)  and  relaionsh^"  (p.  17). 

In  1989,  Oser,  McCallnm,  Salas,  and  Morgan  concluded  that  (a)  it  was  possible  to  identify 
bchaMSfs  fircquently  used  by  crews,  (b)  discriminations  can  be  made  between  nmre  and  less 
cSectivv  crews  based  on  behavioral  observations,  (c)  existing  behavioral  profiles  are  enhanced 
with  the  addition  of  behavioral  examples,  (d)  tite  behavicoal  examples  added  to  our  understanding 
of  team  development,  (e)  these  behaviors  can  predict  team  success,  and  (f)  these  behaviors  can  be 
used  to  de£me  and  identify  the  dimensions:  (Communication,  Cooperation,  Team  Spirit  and  Mmale, 
Giving  and  Accepting  Suggestions  or  Criticism,  Coordination  and  Adaptability.  Subsequent 
research  revealed  how  these  "generic"  behaviors  can  be  tailored  to  fit  an  existing  helicopter 
community. 


Method 

The  approach  taken  to  accomplish  the  objective  of  determining  which  team  building 
behaviors  were  related  to  aircrew  coordination  was  as  follows.  A  review  of  past  aircrew 
coardiaation  literature  and  team  training  literature  revealed  37  behavioral  statements  related  to 
aircrew  coordination.  Interviews  of  20  pilots  in  the  targeted  comnounity  revealed  an  additional  18 
behaviors  which  were  added  to  the  list  Twenty  one  job  experts  were  then  asked  to  verify  the 
is^urtance,  criticality,  difficulty,  and  ficquency  of  occurrence  of  these  bebaviors  on  7'pomt  scales 
(where  7  was  the  high  end  of  tise  scale)  via  survey  nspoosK. 

Based  on  tiie  re^xxises  to  the  first  survey,  revisions  were  made  to  reduce  anobiguity  of  items 
and  to  insure  that  the  items  "made  sense"  to  the  pilots.  The  survey  was  then  readministered  to  a 
second  sample  of  134  job  expens,  and  it  was  found  that  overall,  the  aircrew  coordination 
behaviors  were  considered  veiy  important  to  train  in  pilots  (M  *  5.5)  and  were  very  critical  to 
mission  effectiveness  (M  *  5.7).  Frequency  of  occurrence  was  somewhat  lower  (M.  =  4.2)  and 
difficulty  was  below  the  mu^xuni  of  the  scale  (M  <=  3.7).  The  level  of  agreement  £q}peared  to  have 
bcai  satisfactory  as  evidenced  by  the  standard  deviations  of  the  item  ratings  (78%  were  less  than  a 
1.5  standard  deviation). 

Correlations  between  the  mean  criticality,  difficulty,  frequency,  and  ini.ionancc  to  train 
scores  were  then  calculated.  As  is  evident  in  Table  1,  difficulty  showed  somewhat  lower 
assodation  than  otirer  rating  categories,  indicating  that  subjects  did  not  necessarily  consider  the 
bdiaviors  to  be  difficult,  but  that  they  are  critical  and  should  be  trained.  The  negative  correlation 
between  difficulty  and  frequency  indicated  that  very  difficult  behaviors  occur  less  frequently  than 
casiw  ones.  The  highest  correlation  was  found  between  criticality  and  importance  to  train, 
suggesting  that  subjects  teei  mat  training  is  neetieO  ter  these  critical  skills. 


Tatic  1.  Oanclatioiis  Between  Criticality,  Difficulty 
rrequency,  Impoitsncc  to  Train  Ratings. 


Criticali^ 

Difficulty 

Frequency 

Training 

Qddcality 

1.00 

.25* 

36* 

.88* 

Difficulty 

— 

1.00 

-  37* 

37* 

Frequency 

— 

— 

LOO 

32* 

Training 

— 

— 

— 

1.00 

Note:  n  =  134,  *  £  <  .01 

Results  of  this  data  collectior.  effort  indicated  that  pilots  consider  aircrew  coordination 
behaviors  to  be  important  to  their  jobs.  Cverall,  the  aircrew  coordkiation  bch  tviOTs  w'crc  rated  as 
critical,  fircquently  occurring,  and  important  to  train.  The  lower  ratings  cn  difficulty  indicated  that 
pilots  do  not  consider  aircrew  coordination  behaviors  to  be  difficult  :o  perform,  but  that  they 
should  be  trained  nonetheless. 

Summary 

Now  that  the  importance  and  relevance  of  aircrew  coordinarion  behaviors  have  been 
established  for  this  aviation  community,  they  are  being  used  as  examples  of  the  slcil]?;  needed  for 
the  devclq[Bncni  and  evaluatkw^  of  a  skill-based  aircrew  cowdination  trailing  program.  Based  on 
indepeedent  ciasafkadon  by  job  experts  these  behaviors  have  been  an-anged  undo:  seven 
dimensions:  Mission  Analysis,  Assertiveness,  Adaptability/  Flexibility,  Situational  Awareness, 
Dedsiofi  Making,  Leadership,  and  Cnmmnnir.arinm . 

It  is  not  known  if  these  aircrew  coordination  behaviors  arc  specific  to  the  rotary  wing 
community  they  were  developed  for,  or  if  a  fixed  wing  community  could  effectively  employ  the 
same  behaviors.  It  is  possible  that  the  sldlis  needed  for  effective  aircrew  coordination  are  very 
similar  in  a  variety  of  aviadon  comirainidcs,  and  if  so,  a  standardized  aircrew  cooidinadon  training 
program  could  be  used  by  these  various  communities  with  minor  modificadons. 
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Abstract 

Ccanputer  literacy  is  essential  for  effective 
functioning  in  the  newly  emerging  age  of  communication 
and  information.  It  involves  more  than  being  able  to 
operate  the  computer,  and  must  include  some  basic 
knowledge  of  the  computer  structure  and  technical 
functioning.  A  five  module  workshop  is  proposed  for 
developing  such  ccccputer  literacy  among  select 
Air  Force  personnel,  together  with  a  parallel  form 
of  test  to  assess  strengths  and  weaknesses  both 
before  and  after  the  proposed  workshops. 

Peter  Drucker,  the  Father  of  Management,  maintains  that 
today  we  live  in  a  social  and  tec.hnologicai  revolution,  and  that 
computer  literacy  is  fast  becoming  our  capital  base  {Drucker, 
1909).  In  the  newly  emerging  world  of  the  1990 's  communication 
and  information  will  be  the  watchwords,  and  computer  literacy  has 
become  a  universal  need.  Because  of  the  great  diversity  of  our 
present  workforce  and  schoci  curriculums ,  computer  literacy  too 
often  receives  little  or  no  attention,  and  must  be  dealt  with  by 
the  Air  Force  as  a  first  order  of  business,  if  we  are  to  meet  our 
goals  for  national  security. 

The  CPU  Controversy 

At  the  heart  of  computer  literacy  lies  the  “Computer  Procss- 
ing  Unit"  (CPU),  and  which,  of  course  is  that  part  which  process¬ 
es  the  data.  In  this  sense,  then,  it  is  the  computer.  For  the 
great  mass  of  microcomputers  that  have  emerged  on  the  scene  over 
the  past  decade,  this  clearly  involves  two  principal  CPU's; 
(Borton  and  Rossett,  1989): 

1.  The  PC  88  series  (80-S8  an  8  bit  processor,  80-286  a  16 
bit  processor,  80-386  a  32  bit  processor,  and  80-486  a  32  bit 
pi-OceSaOi’ )  made  by  tiie  Intel  Corporation. 

2-  The  McIntosh  series  (6800  an  8  bit  processor,  68010  a  16 
bit  processor,  68020  a  32  bit  processor,  and  68030  a  32  bit 
processor)  made  by  the  Motorola  Corporation, 
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Intel  has  promised  transparency  between  and  among  the  later 
developments  of  the  evolution  in  the  CPU's;  while  Motorola  has 
net  pro'^lsed  transparency.  This,  cr  course,  means  that  software 
and  programs  purchased  and  running  under  one  series  of  the  CPU 
will  continue  to  run  u.nder  later  developments,  even  though  maybe 
slower  and  much  more  clumsily;  while  Motorola  makes  no  such 
promise.  Therefore,  individuals  who  purchase  the  PC  like  machine 
can  expect  to  continue  to  use  there  programs  with  the  newer 
emerging  CPU's;  while  Motorola  CPU's  would  be  faced  with  the 
threat  of  starting  anew  with  each  later  revision  of  the  CPU. 
There  is  much  to  be  said  tor  the  advantages  and  disadvantages  of 
each  of  these  positions.  This  dialogue  vs’culd  make  a  computer 
literacy  module  worthy  of  concentrated  attention,  but  remains  a 
small  portion  of  what  constitutes  computer  literacy  today. 


The  Functional  Controversy 


There  is  a  group  of  individuals  that  maintain  that  computer 
literacy  must  be  concerned  primarily  with  how  to  run  and  use  the 
computer,  and  not  deal  with  the  structure  and  functions  of  the 
computer  itself.  This,  to  be  sure,  could  make  a  rather  complex 
learning  module,  but  which  would  lack  depth  concerning  hcv.'  the 
actual  processing  takes  place.  It  might,  of  course,,  include  an 
explanation  of  binary  code,  and  how  two  digits  lie  at  the  basis 
of  all  computer  functioning,  and  including  the  use  of  registers 
to  manipulate  data,  but  would  not  necessarily  deal  with  other 
subtletien  related  to  computer  structure. 

Proposed  Computer  Literacy  Workshops 

A  series  of  five  computer  literacy  worksirop  is  proposod  to 
fo.ster  computer  literacy  for  appropriate  i\ir  Force  personnel. 
Each  of  the  separate  workshops  is  planned  to  cover  an  essential 
area  of  development  and  evolution,  and  to  cover  an  evening  and 
the  following  day  of  learning.  Tills,  to  be  sure,  is  completely 
independent  of  hands-on  experis.nce,  and  where  the  needs  will  v.ary 
greatly  depending  on  the  workstations  of  the  personnel  involved. 
For  some  the  experience  might  well  be  in  the  word  processing 
area,  for  others  it  raight  be  data-base  management,  for  still 
others  the  use  of  higher  level  languages,  etc. (Benderson ,  1381): 


V?ORKSHOF  I  - 
WORKSHOP  II 
WORKSHOP  111 
WORKSHOP  IV 
WORKSHOP  V  - 


Computer  Evolution  and  Historical  Devej.cpment . 

Computer  Structure,  Jobs,  and  Languages. 

-  uata  Prcces-sing  and  Statistical  .Analysis  , 
Data  Managema.nt  Systems  and  Memory  Retrieval. 
Word  Processinc  and  Corti.T.uuicatior. . 


WORKSHOP  I  --  Computer  Evolution,  a.nd  Historical  Development 
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This  workshop  is  intended  to  introduce  the  evolutionary 
iopment  of  the  computer  and  historical  events  and  things 


related  tnereto.  This  module  inciudes  a 
Hiation  in  three  areas:  (1)  people,  {2 
vocabulary.  The  outline  for  this  module 


su.mrnary  of  source  inf  or - 
)  breakthroughs,  and  (3) 
is  as  follows: 
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1.  Modern  technology  and  computer. 

2.  Critical  people  in  computer  evolution. 

3.  Critical  "breakthroughs"  in  computer  evolution. 

4.  Specialized  vocabulary  related  to  computer  evolution. 

5.  Impact  of  society  by  computer . 

6.  Nature  and  function  of  computer  literacy. 

7.  Matching  exam  for  critical  people. 

8-  Matching  exam  for  computer  breakthroughs. 

9.  Matching  exam  for  computer  vocabulary. 

10.  Computerized  Computer  Literacy  Test  (COMLTCl). 

WORKSHOP  II  —  Computer  Structure,  Jobs,  and  Languages 

This  module  follows  WORKSHOP  I  logically,  and  seek  to  intro¬ 
duce  the  functioning  elements  of  the  computer,  the  jobs  that  are 
involved  in  computer  applications,,  and  languages  utilized.  A 
summary  of  the  contents  is  as  follows  (Duncan,  1989): 

1.  Computer  generations. 

2.  Computer  sizes. 

3.  Computer  system. 

4.  Computer  structure. 

5.  Computer  secondary  memory. 

6.  Disk  storage  devices. 

7.  Line  printers. 

8.  system  software. 

9.  Computer  careers. 

WORKSHOP  III  —  Data  Processing  and  Statistical  Analysis 

This  module  seeks  to  cover  the  principal  broad  specialized 
areas  for  use  and  applications  of  the  computer,  and  a  summary  of 
the  contents  is  as  follows: 

1.  Statistical  analysis  of  data. 

2.  Architecture  and  engineering. 

3.  Mechanical  simulation. 

4.  Simulation  in  the  behavioral  sciences. 

5.  Guidance  systems. 

6.  Robot  utilization. 

7.  Astronomy  and  space  use. 

8 .  Forecasting  and  predictions . 

9.  High  tech  toys. 

10.  Computerized  music. 

11.  Computerized  art. 

12.  Medical  diagnoses,  and  monitoring. 

13.  Pattern  making. 

14.  Artificial  intelligence. 


WORKSHOP  IV  --  Data  Management  Systems  and  Memory  Retrieval 


This  module  focuses  largely  on  sc.nool  use  and  learning 


..i..  ^  ^  ^  ^  ^  V  »  ^  ...  ^  f  t  .  ^ 
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Truss,  IS 8 9;  and  Stone,  1989); 

1.  Learning  paradigms. 

2.  ERIC  System. 
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Bblice  i&ysteas . 

Eidcitronic  spreadsheets. 
Advanced -accounting  systems . 
Vocational  guidance  systems. 
Library  management  systems. 
Computer  assist  instruction. 
Computer  managed  instruction. 
Case  study  analysis. 


WORKSHOP  V  —  Word  Processing  and  Communication 

This  workshop  seeks  to  focus  on  the  usual  office  support 
systeias  that  have  emerged  through  the  use  of  the  computer,  and  a 
summary  of  the  contents  is  as  follows  (Mendelson,  1989;  Van  Name 
and  Catchings,  1989;  and  Robinson,  et.al.,  1989): 

1.  Word  processing. 

2.  Anagrams  for  crossword  puzzles,  writing  poetry,  etc. 

3.  Information  guide. 

4.  Administrative  applications. 

5.  Media  and  publications. 

6.  Electronic  banking  and  stockbrokerage. 

7.  Electronic  shopping. 

8.  Audio  and  video  support  units. 

9.  Language  translators. 

10.  Telecommunication. 

11.  Security  and  privacy,  and  criminals. 

12.  Computer  Literacy  Test  (COMLTC2) 


Computer  Literacy  Tes!s 


Two  parallel  forms  of  a  computer  literacy  test  have  been 
compiled  and  which  have  been  computerized.  They  are  intended  for 
use  before  and  after  the  five  workshops  to  determine  information 
gained  in  relation  to  computer  literacy'.  Each  of  the  tests  have 
six  part  scores  to  depict  strengths  and  weaknesses  in  relation  to 
computer  literacy  of  students  inv^olved.  Items  are  distributed  as 
follows:  COMLTCl  COMLTC2 

PART  I  -  Computer  Utilization: 

1.  General  information  5  5 

2.  Higher  level  languages  5  5 

3.  I/O  devices  5  5 

4.  Computer  operations  5  5 

5.  Computer  hardware  5  5 

TOTAL  25  25 

PART  II  -  Word  Processing: 

1.  General  information  5  5 

2  -  Editing  commands  5  5 

3.  File  and  block  commands  5  5 

4.  Dictionary  and  spelling  5  5 

5.  No  tile  commands  5  5 

TOTAL  25  25 

PART  III  -  Data  Base  Management: 

1.  General  information  5  5 

2.  Changing  data  base  files  5  5 
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'  -3  -.  "Output  of  database 

5 

5 

'■  4 .  (Manipulating  database  files 

5 

5 

,  ..5.  Data  bahk^ 

5 

5 

.  TOTAL 

25 

25 

PART-  IV  -  Trend/Simulaticn  and  Spread  She 

et : 

1.  Trend  and  analysis 

5 

5 

2.  Simulation 

5 

5 

3.  Spread  sheet 

4 

4 

TOTAL 

14 

14 

P.ABT  V  -  Telecommunication  and  Guidance: 

1 .  General  information 

4 

4 

2 .  Computer  conferences 

5 

5 

3 .  Guidance  systems 

5 

5 

TOTAL 

14 

14 

PART  VI  -  Graphics/Speech/Motion; 

1.  General  information 

4 

5 

2.  Windows 

5 

5 

3.  Motion,  speech,  and  color 

5 

4 

TOTAL 

14 

14 

GRAND  TOTAL 

117 

117 
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Abstract 

Microcomputer -based  modeling  tools  have  the  potential 
to  provide  Air  Force  program  managers  with  significantly  better 
cost/benefit  analysis  capabilities  than  past  paper  and  pencil 
methods  of  performing  these  analyses.  However,  in  an  effort  to 
model  tbe  real  %rorld  accurately,  model  budlders  often  Ignore  the 
human  factors  which  determine  If  the  models  will  be  accepted  by 
the  user.  This  paper  highlights  the  huisan  factor  problems 
observed  in  several  of  the  Air  Force  aierocosputer -based  modeling 
tools  and  recommends  specific  areas  to  which  model  builders  should 
devote  more  attention  if  these  models  are  to  gain  wider 
acceptance . 

Microcomputer-based  (micro -based)  modeling  tools  developed  in  the  1980s 
have  the  potential  to  provide  Air  Force  program  managers  with  revolutionary 
mechanisms  for  conducting  more  rigorous  and  extetuiive  economic  analyses  of 
various  logistics  support  alternatives  for  weapon  systao  acquisitions.  In 
addition,  these  modeling  cools  can  reduce  the  time  necessary  to  complete 
exhaustive  cost/benefit  analyses.  Recent  microcomputer  enhancements  allow  for 
the  development  of  powerful  micro-based  models.  A  decade  ago,  these  models 
were  only  available  on  large  aalnfraise  computer  systems. 

The  use  c£  micro-based  models  has  dramatically  increased  in  the  past 
five  years  (Jeffery,  1989).  Unfortunately,  the  enormous  potential  benefits 
have  not  been  realized.  Many  of  the  obstacles  that  prevent  these  models  from 
gaining  wider  acceptance  are  the  direct  result  of  the  model  builders' 
dismissal  cf  the  Importance  of  the  human  factor  in  the  modeling  equation. 

Carey  (1988)  argues  that  for  complex  taslcs,  such  as  economic  analysis,  Che 
user  is  an  integral  part,  of  the  computer  system.  If  che  system  is  going  to  be 
accepted  by  the  user,  then  ic  must  enhance  the  problem  solving  environment, 
not  degrade  it.  So,  model  builders  must  design  these  micro-based  modeling 
tools  to  fit  the  user.  Instead  of  forcing  the  user  to  fit  the  modeling  tool 
(Uoedson,  1981) .  This  con  only  be  done  by  making  the  human  element  an 
essential  factor  in  Che  model  development  equation. 

The  Lini Cations  on  Model  Acceptance;  Human  Factors 

Human  factors  is  the  scientific  study  of  the  interaction  between  people, 
machines,  anti  their  work  environment  (Beard  A  Peterson,  1988).  In  this  case, 
it  is  the  psychology;  of  information  systems.  When  findings  from  human  faecor 
studies  are  applied  to  the  design  of  information  systems ,  the  friction  between 
cha  user  and  computer  system  is  greatly  reduced  (Scheiderman,  1987).  However, 
when  these  findings  are  ignored  or  blatantly  dismissed,  dysfunctional 
benaviers  ariic  as  described  by  Peterson  and  Peterson  (1988). 
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As  part  of  ari  earlier  study  (Martin,  1989)  seven  micro-based  modeling 
tools  vere  evaluated  to  determine  their  feasibility  in  enhancing  cost/benefit 
analyses  in  Air  Force  program  offices.  During  this  earlier  study,  a  number  of 
human  factor  issues  surfaced.  In  this  manuscript,  the  authors  present  several 
examples  of  the  impact  of  poor  human  factor  design  which  hindered  model 
acceptance  among  program  managers  at  major  Air  Force  program  offices.  These 
examples  fall  into  the  following  categories;  1)  training  difficulties,  2) 
data  collection  difficulties,  and  3)  data  entry  difficulties. 

Training  Difficulties 


Effective  use  of  micro-based  modeling  tools  goes  beyond  an  understanding 
of  how  to  merely  “push  the  proper  buttons."  In  addition  to  fundamental 
microcomputer  skills,  the  model  user  must  also  possess  a  cognitive  (mental) 
model  of  the  process  which  has  been  automated.  Without  this  cognitive  model, 
the  user  becomes  ncthing  more  than  a  parrot,  a  “user  that  executes  commands 
when  cold  to  without  any  undersi:anding"  (Trumbly  &  Arnett,  1989:  4). 

Beyond  a  basic  cognitive  mcd.al  and  some  basic  computer  skills,  it  tc 
also  necessary  for  the  model  user  to  have  seme  rudimentary  knowledge  of  the 
relationship  between  the  input  and  output  parameters.  This  knowledge  allows 
the  user  to  have  an  essential  understanding  of  how  various  model  inputs  can  be 
combined  to  produce  specific  model- generated  outputs.  This  doesn't  mean  that 
the  user  must  understand  every  mathematical  formula  and  their  relationships 
within  the  model.  Ideally,  the  proper  validation  and  verification  steps 
identified  by  Sargent  (1987)  and  Hallam  et.  al.  (1987)  have  been  completed 
prior  to  the  release  of  the  micro-based  modeling  tool.  Nevertheless,  proper 
model  use  does  require  the  user  to  peer  inside  the  model  structure  to  see  how 
it  operates.  Without  this  mental  representation  of  the  process,  it  would  be 
almost  Impossible  for  the  user  to  determine  if  his/her  input  data  had  combined 
to  produce  a  logical  output  or  nonsensical  output. 

As  the  acquisition  of  microcomputers  throughout  the  Air  Force  continues, 
ensuring  that  microcomputer  visers  obtain  a  sufficient  level  of  basic  computer 
knowledge  can  be  a  difficult  task.  Nevertheless,  there  is  evidence  that  the 
Air  Force  is  developing  a  mlcrccomputer- literate  work  force  with  the 
integration  of  microcomputers  into  entry-level  technical  training  courses  and 
into  academic  programs  such  as  the  Air  Force  Academy  and  the  Air  Force 
Institute  of  Technology. 

However,  In  developing  expertise  for  micro-based  modeling  use  within  the 
Air  Force  program  management  environment,  our  observations  indicated  that 
training  for  program  managers  on  how  to  use  these  micro-based  tools  is  often 
poorly  done  or  non-existent.  For  example,  one  program  office  revealed  that 
not  one  of  the  program  managers  responsible  for  performing  cost/benefit 
analysis  woo  using  a  a.icro-based  modeling  tool  to  assist  with  this  task  even 
though  the  uicro-based  tools  were  available.  In  addition,  interviews 
conducted  with  other  Air  Force  program  management  o'*^*’ices  indicated  similar 
nonuse  of  these  micro-based  modeling  tools. 

The  lack  of  available  training  was  cited  as  one  of  the  prijsary  reasons 
for  not  using  these  modeling  tools.  As  one  program  office  division  chief  put 
It,  "My  pregrem  managers  arc  rcspcnsiblc  for  the  sversight  of  betvesn  ten  and 
fifteen  active  projects.  They  don't  have  time  to  sit  down  and  read  through  a 
set  of  complex  user  manuals  to  get  'up  to  speed'  on  how  to  use  one  of  these 
’acdels."  All  toe  often,  the  development,  verification,  end  validation  of  the 
micro -based  modeling  tool  is  the  sole  focus  of  the  model  builder  with  no 
regevd  for  human  factor  issues.  Many  times,  the  only  way  for  a  user  to  learn 
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hov  to  use  these  modeling  tools  is  to  read  the  manioal  or  to  exporlment  with 
the  modeliug  tool.  Needless  to  say,  given  the  day-to-day  pressures  of  the  Air 
Force  acquisition  environment,  many  program  managers  are  hard  pressed  to  find 
any  extra  time  to  devote  to  self-instruction  in  micro-based  modeling  tools. 

As  a  result,  many  times  the  models  go  unused  by  the  people  they  were  intended 
to  assist. 

Data  Collection  Difficulties 

Micro-based  modeling  cools  vary  greatly  in  their  complexity.  At  one  end 
of  the  complexity  continuum  arc  user -developed  models  tailored  for  a  specific 
need.  Often  these  user-developed  models  are  developed  using  commercially 
available  spreadsheets .  On  the  other  end  of  the  continuum  are  composite 
micro-based  models.  These  composite  models  integrate  two  or  more  existing, 
but  smaller,  models  to  facilitate  the  capture  of  multiple  measures  such  as 
reliability,  maintainability,  availability,  or  life-cycle  costs. 

While  the  more  complex  models  provide  the  model  users  with  more 
extensive  analyses,  they  also  require  the  user  to  enter  a  significantly  larger 
amount  of  data.  In  an  effort  to  develop  a  more  complete  model  of  the  world, 
many  of  the  complex  model  builders  have  left  the  data  collection  effort 
entirely  up  to  the  user.  Past  research  (O'Reilly,  1982)  shows  that  when  the 
user  is  tasked  with  data  collection,  the  primary  criteria  used  in  selecting 
the  data  is  accessibility  of  the  data. 

With  one  notable  exception,  all  of  the  micro -based  models  observed  were 
developed  Independently  of  existing  Air  Force  data  systems.  All  of  the  model 
builders  assumed  that  the  xiser  would  know  where  to  get  the  data  needed  to 
operate  the  particular  model.  This  assumption  usually  results  in  users  having 
Ko  locate  and  thoroughly  faailiarlte  themselves  with  several  different  Air 
Fcrce  data  systems.  Without  such  familiarization,  the  successful  use  of  the 
iricro -based  model  is  not  possible. 

In  the  day-to-day  operational  environment  of  most  Air  Force  program 
mac.i-:;^emenC  offices,  such  a  data  system  familiarization  process  is  simply  not 
possible.  As  a  result,  after  program  managers  (model  users)  struggle  for 
awhile  with  the  tremendous  amount  of  data  required  for  many  of  the  more 
complex  models,  most  abandon  the  use  of  the  more  cozo]>lex  modeling  tools 
altogether.  Often  this  leads  to  a  souring  by  the  program  manager  on  the  whole 
micro-based  modeling  experience. 

Data  Entry  Difficulties 

Another  human  factor  which  receives  minimal  attention  from  model 
builders  is  data  entry.  Scheiderman  (1987)  points  out  that  data  entry  can  be 
a  source  of  frustration  and  potential  errors.  For  this  reason,  data  entry 
requirements  for  micro-based  modeling  tools  should  be  given  considerable 
attention.  It  con  be  a  very  frustrating  experience  to  have  the  model  user 
spend  several  days  or  even  weeks  collecting  the  data  needed  to  operate  the 
modeling  tool,  only  to  encounter  additional  problems  In  trying  to  set  up  the 
data  for  the  modeling  tool. 

Smith  and  Hosier  (I98a)  suggest  that  a  guiding  principle  for  data  entry 
is  to  minimize  the  input  action  of  the  user.  By  doing  this,  greater  user 
productivity  is  realized  and  also  less  chance  of  data  entry  errors .  In  one  of 
the  modeling  tools  observed,  over  2500  inputs  had  to  be  made  before  the  model 
could  be  executed.  Smith  and  Hosier  (1984)  also  argue  that  redundant  data 
entry  should  be  avoided  at  all  cost.  In  the  example  cited  above,  the  model 


109 


■'  rj. 


required  t^c:  rekeylng  of  the  same  ten  data  elements  2S0  tiiiies  to  make  the 
inodel  executable.  In  an  effort  to  measure  the  magnitude  of  this  data  entry 
tiask,  one  c£  the  autliors  spent  over  five  hours  Just  entering  the  data  required 
to  run  tills  model.  Is  it  any  wonder  that  micro-based  models  of  this  type  are 
placed  on  th?  shelf  and  go  unused? 

Another  data  entry  difficulty  encountered  was  with  the  data  entry 
format.  In  fact,  the  data  entry  format  of  two  of  the  models  observed  was  the 
primary  reason  they  were  rejected  for  an  earlier  feasibility  study  (Martin, 
1989) .  'Qiese  two  models  required  the  construction  of  ;:<»parate  American 
Standard  Code  for  Information  Interchange  (ASCII)  te^t  files,  complete  with 
data  entries  in  all  the  correct  places  within  the  file.  This  data  entry 
format  procedure  makes  the  faulty  uii.uxiii,ption  that  the  model  users  will 
understand  how  to  perform  this  esoteric  task,  and  that  once  they  understand 
how  to  perform  the  task,  they  have  the  x>atience  to  accomplish  it.  Since  most 
mlczoccmtputer  users  are  application  users  and  not  power  users,  they  will 
quickly  abandon  the  use  of  these  models  in  favor  of  those  that  require  less  of 
a  data  entry  burden,  even  if  the  model  does  not  provide  as  accurate  a 
repriisentatlon  of  the  real  world. 

Implications  and  Summary 

Vhile  micro-based  modeling  tools  exist  which  give  consideration  to  one 
or  more  of  the  human  factors  menticned,  It  is  clear  that  additional  emphasis 
must  be  placed  on  human  factors  before  these  models  will  become  widely 
accepted  fox  tise  in  ati  Air  Force  ptograa  management  environment.  Many  of 
these  models  are  quite  complex,  and  in  the  absence  of  any  formal  training 
program,  many  of  ^e  model  users  do  not  have  the  extra  time  required  for  self- 
instruction.  It  is  possible  that  embedded  training  systems  or  computer-based 
training  systems  which  simulate  the  modeling  process  could  be  excellent  tutors 
for  inexperienced  users. 

In  addition,  while  many  of  these  models  accurately  reflect  reality, 
their  concentration  on  details  often  places  unrealistic  data  collection 
burdens  on  program  managers.  Ideally,  a  balance  needs  to  be  struck  between 
model  accuracy  and  data  collection  requirements.  The  best  micro-based 
modeling  tool  observed  during  the  feasibility  study  (Statistically  Improved 
Life  Cycle  Cost  Model)  not  only  strikes  this  balance,  but  also  guides  users  in 
chelx  data  collection  effort.  For  example,  tills  modeling  tool  provides  the 
user  with  the  data  collection  requirements,  as  well  as  the  name  and  phone 
number  of  the  agency  having  access  to  the  required  data. 

Furthermore,  model  users  are  often  burdened  with  trying  to  determine  the 
proper  way  to  enter  data  into  the  model.  Only  two  of  the  seven  models 
examined  provided  the  user  with  an  effective  data  entry  screen  that  included 
adequate  on-line  help  for  each  data  entry  and  reduced  excessive  repetitive 
data  entries. 

In  summary,  microcomputer -based  modeling  tools  are  still  in  the 
developmental  stage.  ‘Hie  primary  thrust  of  model  builders  to  this  point  has 
been  to  deliver  models  that  accurately  reflect  reality.  While  this  is 
important,  the  price  for  this  realism  has  been  Che  neglect  of  the  model  user 
in  the  areas  of  training,  data  collection,  and  data  entry.  Unless  more 
emphasis  is  placed  on  these  important  hriman  factor  Issues  in  future,  it  will 
be  some  time  before  these  micro-based  modeling  tools  make  inroads  into  the  Air 
Force  program  manager  environment. 
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Abstract 

Recent  leseaich  has  shown  that  an  interface  for  software  ^iplicatioDs  is  more 
effective  whm  it  considers  the  commonication  needs  and  memory  load  of  the  user  and 
provitfcs  a  (insistent  model  of  the  systgn.  This  paper  describes  a  tnousediiven  menu 
interface  for  a  microcomputer  running  the  MS-DOS  Ofperating  system  Tlur  interface 
was  developed  and  is  conently  being  used  by  die  class  of  93  at  the  United  States  Naval 
Academy. 

Ihe  advent  of  mandatory,  student  owned  nsicrocOTiputers  in  the  academic  environment  has 
created  the  need  to  insure  diat  stuttents  indeed  use  them.  This  {roblem  has  not  arisen  in  the  past 
mainly  because  students  generally  had  only  limited  exposure  to  cen^uters  in  high  school  and  few 
computer  illiterate  students  owned  their  own  computer.  However,  with  more  and  better 
educational  software  available,  coaqmtg  usage  has  filtrated  down  into  the  dementaiy  schools.  As 
a  leadt  more  and  mcne  college  freshmen  have  had  exposure  to  the  c^tabilidcs  of  the  cen^mr  and 
several  omversitia  now  eccourage  or  require  them  to  purchase  their  own  microcomputer. 

Since  dre  counter  is  now  an  integral  part  of  the  United  States  Navy,  the  United  States  Naval 

fK^  /•Ivcc  r^f  Of%  U«e  tr>  m 
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microcomputer,  h  was  soon  discovered  that  ownership  did  not  necessarily  ensure  usage.  Since 
thdr  inception,  the  overall  curriculum  of  the  Academy  has  been  strengthened  to  incorporate  the 
computer  in  all  a^>ects  of  the  midshipmen's  academic  and  professional  endeavors.  Even  though 
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y>{my  of  the  ffiidsfaipmen  have  had  prior  expr^ure  to  computers,  their  experieacc  with  MS-DOS 
has  general^'  been  limited.  As  a  result,  it  became  necessary  to  rapidly  and  effectively  transfoini 
aj^iDximately  1500  plcbcs  into  computer  literate  users.  To  this  end,  the  Academy  began 
develt^ting  various  interfaces  for  the  MS-DOS  enviroome&L 

History 

The  injrial  attempt  to  acclimate  the  trudshiptoen  to  their  computers  was  to  provide  a  single 
USNA  Menu.  Since  it  vm  a  yard  v^idc  problem,  this  interface  was  developed  by  Computer 
Services.  It  presented  the  user  with  a  list  of  optLcms.  driven  by  function  keys,  that  launched  each 
of  iht;  inajcff  software  applications  in  use  at  the  Academy.  However,  once  the  ^plication  was 
the  tnidshipmen  found  thcmsclvcs  ui  the  MS-DOS  command  line  environment  which 
also  required  them  to  remonber  the  correct  path  name  of  all  the  files. 

A  tadf  can  be  convicted  nxat  easily  when  the  amount  of  information  necessary  to  perform 
the  task  is  kept  at  a  minitrium.  This  infmmation  is  stored  in  a  person's  long  term  memory  and 
must  be  transferred  to  his  short  term  memory.  In  order  to  reduce  this  load  on  the  midshipmen's 
working  memory,  the  Computer  Science  Department  introduced  a  software  application  called 
Directory  Scanner™  ^  This  application  is  a  graphical  display  of  the  hicrarchicai  file  systan  whidi 
by  u^g  function  key's,  allows  die  user  to  traverse  the  hierarchy  of  diiectmcs.  Once  he  located  the 
desired  directory,  pressing  the  Enter  key  di^tlayed  the  files  contained  in  it  He  could  then  select 
the  desired  file  by  using  the  anow  keys.  But  once  again,  the  midshipii^  were  dependent  on 
function  keys  and  the  command  line  to  accoo^tlish  any  useful  work. 

Since  long  term  memory  encodes  material  that  is  meaningful,  students  are  normally  not  as 
pmficiem  at  remembering  facts  as  they  are  at  remcnibcring  ruics.  Ihe  MS-DOS  operating  system 
is  ofteri  associated  with  the  ability  to  remember  facts  whereas  a  mouse  is  more  frequently 
associated  with  rules  (Ibomson,  1984).  Based  on  this,  it  became  evident  that  an  interface,  more 
dependent  on  be  use  of  a  mouse,  needed  to  be  developed. 

One  of  the  obstacles  to  a  mouse  driven  interface  was  the  lack  of  memory  and  disk  space 
available  on  the  plebe  machine.  However,  this  difficulty  disappeared  with  the  class  of  93,  when 
each  plebe  was  required  to  purchase  a  Zenith  286  LP  microcompuicr  with  one  megabyte  of  RAM, 
a  20  megabyte  hard  disk  drive,  a  1.4  megabyte  single  floppy  disk  drive,  a  VGA  color  monitor  and 
a  D>gitcch  mouse.  The  Computer  Science  Department  and  Computer  Services  undertook  to 
develop  a  mouse  driven  interface  to  facilitate  the  plebes'  acclimation  to  the  machinc(Gcschkc, 
Borrits,  Visco  and  Rowe,  1989). 


^  Directory  Scanner^  v  3 J  was  devclof-id  by  Nsl  Martiiw. 
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The  Plebc  Interf^ 


A&cr  a  review  the  literature  of  current  interface  designs,  wc  decided  to  develop  and 
implement  a  closed  design  that  relies  tOuUly  on  the  mouse.  The  metaphor  for  a  closed  system  was 
first  presented  by  Laurel  (1986).  Such  a  system  behaves  deterministicaiiy  and  no  important 
aspects  of  its  bdiavior  arc  omitted.  In  such  a  system,  the  user  should  be  able  to  form  a  mental 
model  of  the  system  that  is  complete  and  obvious.  Hence  the  actions  the  user  kams  to  perform  the 
first  time  he  uses  the  system  will  cause  him  to  form  a  model  of  the  syatem  that  will  help  him  in 
u^g  the  system  in  the  future.  Any  new  actions  that  he  encounters  will  be  explainable  in  terras  of 
the  model 

The  plebc  interface  is  developed  on  of  Directory  Scanner™  and  allows  for  traversal 
through  both  the  directory  hierarchy  and  the  corresponding  files  using  the  mouse.  However,  to 
ensure  acceptance  among  users  who  were  already  adept  with  the  MS-DOS  environment,  the  entire 
interface  can  be  manipulated  using  function  keys,  etc.  This  fact,  however,  is  not  stressed  to  the 
naive  user. 

The  Logitech  mouse  consists  of  three  taitions.  The  left  button  is  used  for  Elscape,  the  middle 
one  will  bring  up  the  Help  Menu  and  the  right  one  designates  Enier.  Four  chords  are  available  by 
combining  buttons.  Pressing  the  left  and  middle  buttons  will  toggle  the  directory  section  of 
Directory  Scanner™.  The  midshipman  then  moves  the  mouse  to  the  desired  directory  and  selects 
it  using  the  right  mouse  button,  ’rhis  action  causes  the  files  in  that  directory  to  be  displayed.  He 
can  then  move  tiic  mouse  to  the  desired  file  and  select  or  tag  it  by  pressing  the  middle  and  right 
mouse  buttons. 

The  interface  maintains  a  Main  and  a  File  Command  Menu  for  Directory  Scanner™  and  for 
the  other  software  applications  in  use  at  the  Academy.  As  software  applications  are  added  or 
changed,  they  can  be  accessed  by  the  plebc  interface  once  menus  arc  written  for  them  and  the 
Directory  Scanncr™'s  Main  Menu  is  modified.  The  Main  Menu  is  laought  up  by  pressing  the  left 
and  right  mouse  buttons  and  contains  cations  for  the  major  tasks  penineni  to  each  application.  For 
example,  the  Main  Menu  at  the  Directory  Scanner™  level  contains  options  that  launch  applications 
such  as  Qukksoft's  PC-Wiite™,  Borland's  Turbo  Pascal™  and  CJuattro™,  ProComm™  and  an 
in  house  Math  Plotting  Package.  In  launching  an  application,  the  interface  removes  Directory 
Scanner™  from  memory,  loads  the  menus  for  the  application  and  then  executes  the  application. 
Upon  exiting,  it  reloads  the  Directory  Scanner™  menus  and  Directory  Scanner™.  The  Main 
Menu  also  provides  options  for  formatting  data  and  system  disks  and  for  shutting  down  the 
system. 

The  Main  Menu  for  each  of  the  applications  is  comparable.  For  example,  in  the  PC-Write™ 
application  it  contains  options  for  cutting  and  pasting,  scaiching  and  replacing,  traversal  of  the  text 
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aiui  Xamaaing  the  t&xL  In  the  Turbo  Pascal‘s  application,  options  are  pio\ided  for  running  or 
coB^uiing  a  program,  several  debugging  techniques  and  saving  a  file.  The  ProComm*™  menu 
provides  for  a  system  break,  a  redisplay  of  the  last  screen  and  an  exit  to  and  from  MS-DOS.  The 

Hcrtting  Package  menu  provides  opdons  for  graphing  integrals,  slopes,  contour  lines,  vectors 
aad  detenniniag  roots  to  equations.  The  builtin  menus  for  Quattro’^  were  sophisticated  enough 
that  the  plebc  interface  siir^jly  defaults  to  them.  Each  of  the  Main  Menus  provide  an  Exit  option 
that  returns  the  student  to  Directory  Scanner''^M  and  an  option  that  invokes  the  File  Command 
Menu. 

The  File  Command  Menu  can  be  tax>oght  up  either  from  the  Main  Menu  or  by  pressing  ail 
dare  mouse  buttons.  The  cations  in  the  File  Command  Menu  at  the  Directory  Scanner™  level  are 
the  typical  MS-DOS  commands  that  allow  for  files  to  be  listed,  copied,  moved  and  deleted.  In 
addition,  it  provides  options  fty  modifying  directories  and  changing  disk  drives.  Several  of  the 
commands  will  bring  up  a  second  menu.  For  example,  when  the  Copy  File  option  is  selected, 
another  menu  providing  vanoos  destinations  will  ^>pcar. 

The  File  Command  Menu  for  PC-Writc™  provides  options  for  inserting  and  printing  files 
and  various  save  and  exit  commands.  In  Turbo  Pascal^M,  the  menu  provides  various  editing 
crommarKis  while  in  ProComm™,  it  provides  fw  opening  and  closing  log  files.  The  Command  File 
Menu  for  die  Math  Plotting  Program  is  embedded  in  each  of  the  Main  Menu  options  and  is  still 
driven  by  function  keys.  The  first  option  in  each  Fils  Command  Menu  is  Exit  which  returns  the 
user  to  the  aj^Ucation. 


Summary  and  Conclusions 

Two  Saturdays  prior  to  the  commencement  of  classes,  the  plcbcs  were  issued  their 
computers,  the  software  applications  and  a  Quick  Start  manual  (Wclcher,  1989).  The  first 
Saturday,  under  the  supervision  of  a  technical  advisor  from  Computer  Services  or  the  Computer 
Science  department,  the  plebes  set  up  their  machmes  and  started  on  the  Quick  Start  manual.  This 
gave  them  an  introduction  to  the  use  of  the  mouse  with  Directory  Scanner™  and  allowed  them  to 
use  ProComm™  to  connea  to  the  Naval  Acadany  I^ua  Network.  The  second  Saturday,  under  the 
supervision  of  Computer  Services  and  the  Chemistry  department,  they  were  given  a  Quattro™ 
Quick  Start  manual  (Pearson,  1989)  and  an  intrcxluction  to  the  use  of  the  software. 

During  the  first  week  of  classes,  the  Naval  Leadership  and  English  depanraents  required  each 
plcbe  to  submit  a  paper  that  had  been  written  using  the  PC-Write™  word  processing  application.. 
Half  of  the  plcbe  class  also  started  the  required  Fundamentals  ot  Computing  course  which 
immediately  reviewed  all  of  the  software  applications  and  then  immersed  them  into  pascal.  By  the 
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end  of  tbe  second  w<»k  of  classes,  most  picbcs  v.'crs  able  to  use  tftcir  cooiputcrs  in  a  producuve 
manner. 

The  pkbc  mrcxfacc  was  developed  lo  reduce  the  memory  overload  that  occurs  when  a 
mid^pman  is  first  introduced  to  a  computer  operating  system  and  various  software  applications. 
Although  no  anpiical  studies  have  yet  been  concluded  diat  verify  the  rffcctivcness  of  tltt  interface, 
all  indicatioas  are  that  the  class  of  93  made  the  transition  fiom  novice  to  computer  literate  in  a  more 
rapid  and  effective  manner  than  any  of  the  prior  classes.  Funner  studies  are  indicated  to  determine 
whether  the  interface  facilitates  the  midshipmen’s  continual  usage  of  their  computer. 
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Abstract 

The  purpose  of  this  paper  is  to  describe  the 
developmental  process  of  designing  the  physical 
aspects  of  a  prototype  interface  device  to  fulfill 
the  integrated  Maintenance  information  System 
concept.  The  paper  describes  a  history  of  the 
reguire<eent&  analysis,  details  software  toolkit 
design,  discusses  keyboard  options  and 
arrangements,  and  outlines  user  needs  for  the 
physical  design  of  a  Portable  Maintenance  Aid 
(PMA)  for  use  by  maintenance  technicians. 

For  over  twelve  years  the  Air  Force  Huxaan  Resources 
LtJaoratory  at  Wright-Patterson  Air  Force  Bass  has  been 
conducting  research  to  develop  methods  o£  presenting  technical 
information  on  a  portable  computer  to  support  its  Integrated 
Maintenance  information  System  (IMIS)  development  program. 

The  IMIS  concept  is  one  that  will  provide  an  aircraft 
maintenance  technician  with  a  single  computer  interface  to  the 
Information  and  data  bases  that  he  needs  to  access  and 
Interrogate  to  accomplish  his  work.  The  technician  will  use  a 
hand-held  portable  computer  that  interfaces  directly  with 
existing  maintenance  data  bases  and  the  multiplex  data  bus  or 
the  aircraft,  it  will  perform  built-in  tests,  read  and 
analyze  fault  data,  provide  diagnostic  advice,  and  present 
automated  technical  procedures.  IM7S  will  directly  impact 
sortie  generation  in  a  very  positive  manner  by  improving  the 
performance  of  the  maintenance  technician. 

The  Laboratory  initiated  its  investigation  of 
presentation  requirements  for  autonated  technical  information 
by  developing  a  prototype  computer  system  to  support 
maintenance  activities  in  the  shop.  The-  prototype  was  used  to 
demonstrate  the  feasibility  of  the  concept  and  to  conduct 
research  on  specific  human  factors  issues.  The  in-shop 
prototype  was  located  in  a  sheltered  area,  so  a  full  size 
ccieen  for  presentation  and  a  keyboard  for  data  entry  ware 
wised.  After  successfully  completing  the  in-shop  tests,  the 
lessons  learned  were  carried  over  to  the  development  of  a 
prototype  computer  for  flight  line  use.  The  flight  line  work 
environment  induced  severe  size  and  weight  restrictions.  The 
prototype  computer  must  be  small  and  easily  portable;  thus, 
the  screen  sice  and  number  of  keys  must  be  limit!.  These 
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jcestricttons  impcse  many  unique  and  difficult  human  computer 
ititetaction  requirements.  The  Laboratory  iz  designing  an 
interface  that  will  support  various  levels  of  computer 
expertise/  varying  levels  of  experience  on  specific 
BiAintenance  tasks,  and  will  be  suitable  for  a  variety  of 
maintenance  tasks.  The  final  design  of  the  PMA  must 
incorporate  the  general  needs  of  the  user  and  the  mere 
specific  human  factors  engineering  issues  that  will  lead  to  a 
user-'f riendly  system.  This  paper  describes  the  procedures 
used  in  designing  a  human  computer  interface  ti;at  meets  the 
needs  of  the  aircraft  maintenance  technician.  At  this  stage  of 
development  of  the  PMA,  the  initial  layout  is  completed,  but 
there  are  several  issues  concerning  the  presentation  system 
and  interaction  techniques  which  are  being  investigated  and 
adapted  as  current  technology  evolves. 

Method 

The  Laboratory  has  taken  several  steps  in  developing  a 
human- computer  interface  design  for  a  portable  maintenance 
aid.  P.  functional  analysis  of  the  users'  requirements  was 
performed  by  human  factors  engineers  (HFE).  The  HPEs 
established  a  fundamental  set  of  system  tequirements  from 
interviews  with  maintenance  technicians,  experience  on 
previous  projects,  and  the  reviews  of  other  automated  systems. 
The  £fEs  determined  that  a  graphical  user  interface  (GUI) 
would  provide  the  most  effective  means  of  meeting  the 
technicians'  needs  and  the  Laboratory's  design  goals.  After 
making  the  decision  to  use  a  GUI,  the  BFEs  defined  the 
fundamental  software  elements  needed  to  build  the  software 
toolkit  required  to  develop  the  GUI.  A  software  toolkit  is 
used  to  build  the  application  software  for  the  prototype. 

The  next  phase  in  our  prototype  design  is  to  develop 
maintenance  scenarios  and  screens  on  a  computer  with  rapid 
prototyping  capabilities  including  hypertext  links.  Using 
these  powerful  linking  mechanisms,  we  can  visualize  worst-case 
scenarios  on  the  flight  line  and  identify  what  resources 
technicians  would  need  from  the  computer  in  each  maintenance 
situation.  By  doing  this,  we  can  enhance  our  initial  software 
toolkit  to  include  a  more  detailed  arrangement  of  interactive 
elements . 

Our  initial  software  toolkit  consists  of  elements  mainly 
for  navigation,  sequencing,  and  data  entry.  A  few  examples 
are  SCROLLER,  BUTTON,  MENU,  DIALOG  BOX,  and  WINDOW.  A  SCROLLER 
provides  the  capability  for  viewing  an  illustration  that  is 
larger  tnan  the  screen,  a  buTtOn  is  a  mechanism  that  allows 
the  viewer  to  choose  a  response.  A  MENU  is  a  list  of  options 
the  viewer  might  have  in  any  one  scenario.  A  DIALOG  BOX  is 
another  mechanism  that  allows  the  viewer  to  choose  one  of 
several  responses.  The  WINDOW  is  the  basic  frame  inside  which 
all  activity  occurs.  The  WINDOW  har  several  components. 
WINDOWS  have  frames,  an  area  in  which  to  read  and  interact 
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with  data,  title  bar,  and  a  scroller.  The  WINDOW  can  be 
altered  in  s.ize,  location,  or  content  by  the  programmer  as 
well  as  the  technician.  The  user  must  navigate  through, 
sequence,  and  input  the  data  presented  in  the  windows  by 
moving  the  cursor  to  enter  his  commands.  This  cursor 
interaction  is  required  due  to  a  graphical  user-interface  and 
accomplished  through  various  input  devices  such  as  a  keyboard, 
mouse,  touch  pad,  touch  screen,  track  ball,  and  joystick. 

An  input  device  that  is  fast,  accurate,  easy  to  use,  and 
appropriate  for  use  in  the  maintenance  environment  is  needed. 
The  mouse  was  considered  inappropriate  for  our  PMA  in  a 
flight  line  environment  because  the  PKA  must  be  a  single, 
self-contained  unit.  A  mouse  would  be  an  extra  device  that 
the  technician  would  have  to  carry,  along  with  his  tools.  The 
joystick,  the  touch  tablet,  the  touch  screen,  the  track  ball, 
and  the  keyboard  are  being  evaluated  specifically  for  the 
maintenance  environment.  Size  is  a  critical  issue  in 
considering  input  alternatives. 

Specifications,  design  considerations,  and  technology 
limitations  dictated  that  the  box  be  about  five  pounds  in 
weight,  with  a  screen  size  of  d**  by  8".  The  computer  must  be 
suitable  for  carrying  and  operating  with  one  hand.  The 
joystick,  according  to  most  engineers  in  the  branch,  would  be 
damaged  in  flight  line  handling  since  it  would  stand  above  the 
surface  of  the  PitA  and  is  very  fragile.  A  touch  screen  is  a 
possibility.  However,  there  is  concern  that  dirt  and  grease 
on  the  hands  of  the  technicians  will  obscure  the  display. 

Also,  there  is  a  risk  of  damage  to  the  display  if  the 
technicians  should  use  their  tools  to  "touch"  the  screen.  A 
touch  tablet  and  trackball  could  have  the  same  degraded 
functionality  due  to  conditions  in  a  dirty  environment  and 
would  add  extra  weight  to  the  FUA.  Although  the  keyboard 
entry  method  appears  to  be  the  most  viable  method  of  entering 
information  into  the  PHA  available  at  this  time,  we  will 
research  the  aforementioned  devices  further. 

Regardless  of  the  choice  of  input  devices,  the 
maintenance  technician  should  not  be  required  to  use  two  hands 
for  data  input.  In  fact,  one  of  the  goals  behind  this  PHA 
design  was  to  eliminate  any  need  for  the  technician  to  have 
extensive  typing  skills.  The  PKA  keyboard  should  have  no 
alpha  character  keys,  and  it  should  allow  the  technician  to 
operate  the  machine  with  one-  or  two-  button  presses. 

Once  we  had  established  the  keyboard  as  the  most  likely 
input  device,  it  was  necessary  to  determine  how  many  keys 
would  be  needed,  which  keys  would  be  dedicated,  which  would  be 
software  programmable,  and  how  they  would  be  arranged  on  the 
computer.  We  then  had  to  define  the  function  of  those  keys 
which  were  not  directional.  We  first  listed  all  the  functions 
the  computer  has  to  perform  based  on  the  different  types  of 
information  displayed  and  users'  needs.  Based  on  the 
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knovXed9r«  of  the  maintenance  staff  and  the  results  from 
sevetzLl  field  tests  and  interviews  with  technicians,  we 
identified  critical  functions  for  which  dedicated  keys  would 
he  provided.  Dedicated  keys  would  be  reserved  for  those 
functions  that  the  technician  wanted  to  perform  often  and  that 
bad  no  branches  or  further  menu  items  attached  to  them.  For 
example,  NEXT,  BACK,  and  MENU  BAB  should  be  dedicated  keys 
becau: e  when  the  technician  wants  to  go  to  the  next  frame, 
he/she  should  be  able  to  do  so  with  one  singular  action  on  the 
keyboard.  With  one  press  of  NEXT,  the  technician  could  view 
the  next  resource  available.  For  more  infrequent  actions  like 
changing  the  font  or  for  actions  that  could  have  many 
different  alternative  choices,  <e.g.,  calling  for  HELP,  the 
technician  can  obtain  this  information  with  a  combination  of 
numerical  keys  or  selecting  options  from  a  menu.  We  also 
included  six  function  keys  on  the  keyboard  to  act  as  dyn2u&ic 
options  that  the  technician  would  want  to  select  with  only  one 
keystroke.  Dynamic  options  are  functions  which  are  not  always 
available.  Their  availability  is  specified  in  the  data  itself 
when  they  are  available.  They  are  identified  in  a  box  on  the 
window.  A  few  of  these  functions  are  SCROLL,  ZOOM,  CROSS 
REFERENCES,  BOOKMARK,  YES/NO,  and  HELP. 

In  conjunction  with  the  function  key  decisions,  we  had  to 
determine  the  key  arrangement  on  the  computer.  The  basic 
objective  was  to  minimize  the  size  of  the  computer.  Should 
the  computer  be  made  ee  physically  small  as  technology  will 
allow,  without  regard  to  ease  of  use?  Or,  should  it  be  made 
somewhat  larger  to  allow  more  convenient  placement  cf  keys? 
There  were  arguments  for  both  sides.  The  main  problem  the 
technicians  had  pointed  out  during  evaluations  of  previous 
prototypes  was  that  they  were  too  large  and  awkward  to  handle 
in  small  areas.  Basically  the  design  engineers  and  the  human 
factors  engineers  had  to  compromise.  The  box  would  have  to  be 
as  small  as  possible,  but  the  number  keys  had  to  be  arranged 
in  a  logical  order.  The  direction  keys  had  to  be  kept  in  a 
usable  arrangement,  and  the  keyboard  had  to  be  somewhat 
similar  to  what  people  are  accustomed  to  viewing  and  to  using 
{e.g.,  typewriter,  tabletop  computers,  etc.).  With  a  growing 
body  of  technology  and  experience,  our  team  of  engineers  will 
be  able  to  decrease  the  size  of  the  interface  without 
sacrificing  comfort  and  ease  of  use  to  the  technician. 

With  the  needed  functions  developed,  we  began  to  arrange 
the  physical  design  of  che  PMA  which  included  how  the  computer 
was  held,  its  weight,  its  maneuverability,  comfort  of  the 
user,  and  general  human  factors  design  considerations.  We 
began  this  task  simultaneously  with  all  the  others  by  taking  a 
survey  of  the  technicians  at  Homestead  afb,  Moody  AFB, 
Springfield  Guard  Unit,  and  the  4350th  Test  Wing  at 
Wright-Patterson  AFB.  The  engineers  in  the  Laboratory  also 
added  Human  Factors  issues,  but  those  issues  of  importance  to 
our  engineers  were  not  related  to  those  of  the  maintenance 
technicians.  The  Human  Factors  specialists  were  concerned 
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vith;  key  placement  (Fitt's  Law),  balance  of  the  computer, 
order  and  arrangement  of  number  keys,  and  input  device 
•election.  But  the  technicians  did  not  respond  to  those 
concerns.  Instead,  they  wanted  ease  of  transportaii^ility;  they 
wanted  ruggeoness;  they  wanted  simplicity;  they  wanted  a 
non-repair  item;  they  did  not  want  this  portable  device  to  be 
a  hassard  while  moving  around  the  aircraft.  They  wanted  to  be 
able  to  hold  the  computer  with  one  hand,  sit  it  on  the  ground, 
dr  hook  it  on  a  tripod-like  device,  in  the  final  design  of 
the  Pith,  Qur  engineers  will  have  to  ensure  the  general 
interests  of  the  technicians  are  met,  along  with  the  more 
specific  yet  vital  concerns  of  the  Human  factors  specialists. 

Conclusion 

The  development  of  the  human-computer  Interface  is  an 
evolving  process.  The  first  test  of  the  PMA  will  be  in  the 
Fall  of  1990.  The  lessons  learned  from  this  test  will  be 
evaluated  and  utilized  to  advance  the  larger  IMIS  concept, 
which  will  give  the  maintenance  technician  a  single  interface 
with  which  to  access  and  utilize  the  information  and  data 
bases  he  requires  to  accomplish  his/her  work. 


SIZE IJOG^TKJN  EFFECTS  ON  TOUCH  PANE.  PERFORMANCE; 
UK«TS  ON  INTERPRETATJON  AND  INFERENCE 


Dennis  B.  Bering 
New  Mexico  Stete  Universily 


Abstract 

Accuracy  of  input  using  touch  panel  devices  is  affected  by  a  mmiber  of  variables, 
pardcuf^y  those  nsisding  to  the  teffget  of  the  touch.  A  screening  experiment  was 
conducted  to  further  exarnkte  the  eNects  of  target  posiban  and  upon  accuracy  of 
the  touch  input.  Fi^rtts  suggest  that  error  frx  rig'  1-handad  users  is  least  near  the 
resting  position  of  the  hand  (lower  right  corner  of  olspiay)  and  that  response 
timm  weue  ^itariy  affected.  Accuracy  was  greater  tor  targets  demarKfing  higher 
precision.  It  Is  recommended  that  for  appliaitlons  having  established  key  input 
areas  positions  along  the  lower  aruf  right-hand  borders  of  the  control/display  unit 
s/KMiW  be  used  to  minimize  activation  time  and  error.  Use  of  the  tower  border 
exciusively  can  accomodate  users  with  either  a  right-hand  or  left-hand 
pra/er«nce.  Some  comments  are  also  provided  on  the  limitadons  which  bound  the 
It^erpretabon  of  results  in  several  studies  and  inferences  thus  drawn. 


There  is  currently  an  Interest  In  defining  guidelines  implemef^g  toudi-sensifivs  in- 
ttfteces  In  Naval  appUcations.  TTw  literature  contains  a  variety  of  studies  that  have  investi¬ 
gated  variables  aftec^  the  accuracy  with  whid)  Irxlividuais  can  use  touch-input  devices.  TT>e 
variablee  examirwd  have  included  ttte  operator's  an^  of  regard  (Beringer  &  Person,  1985; 
HaU,  Ckioningtiafn,  Roache  arxi  Cox,  1988;  Beringer  &  Bown^  1989),  location  of  the  target  on 
the  screen  (Bering;  Hall,  et  aU,  1988,  Beringer  aiKl  Bowman,  1989),  technology  type 
(Schutee  &  Snyder,  1983;  Beringer,  1989),  on-screen  vs.  off-screen  Input  device  (WWtflaid, 
Ban  and  Bird,  1983)  and  other  devices  versus  t<xich  ir^>u  (Karat,  McOon^  emd  Anderson, 
1986;  Berkiger,  1989).  There  have  also  been  some  examWions  of  the  efficacy  of  training 
(feedback)  in  improving  touch-input  performance  (Berkiger  &  Peterson,  1985;  Beringer, 
1989)  as  weO  as  studies  of  the  eftocts  of  various  typ^  of  gioves  on  operator  performance 
(Bering^'  &  Lee.  1988;  Beringer,  1939). 

AS  this  data  coRected  on  nunerous  devices  of  varying  tedmoiogies  has  produced  sometimes 
complementary  and  sometimes  confMcdrrg  results,  or  so  it  would  appear.  The  apparent  con¬ 
flicts,  however,  may  in  many  cases  be  a  fundion  of  problems  of  interpretation  or  erroneor.6 
kderence.  Thus  it  may  be  useful,  prior  to  reporting  the  resutts  of  yet  another  study,  to  exam¬ 
ine  some  of  the  inherent  iimitations  that  may  be  overlooked  in  reportkig  arvd  Interpreting  fincf- 
ings,  nd  ody  of  other  researchers  but  dten  in  our  own  work. 

Limits  of  interpretation  and  inference 

Error  rates.  Hail  et  al.  (1988)  suggested  that  no  studies  had  previously  provided  activation 
error  ratss  for  touch  panel  operation.  This  is  rather  mtsleadng  In  that  an  "error  rate"  is 
merely  a  function  of  the  desired  predsion  of  activation  and  can  be  determined,  as  did  Hall  et  al. 
after-Uie-fact  In  Uwlr  Experiment  1,  by  applying  accept/reject  criteria  to  any  collection  of 
recorded  responses.  Data  from  earlier  studies  citing  specific  error  data  (x.y  distance  from 
target)  coutd  nave  been  adapted  to  any  application  provtdeo  that  some  small  central  contact  point 
was  i^iecified  for  each  touch  target  (parity  of  visual  targets).  Thus  the  data  that  have  been  coi- 
iected  coocemlr>g  input  accuracy  over  the  past  decade  are  most  likely  applicaWe  to  a  number  of 
sibicdions  if  some  standard  of  interpretation  can  be  adopted. 


<  •  ■  V.—  - 


One  must  be  extremely  careft^  when  citing  data  old  of  corUext 


et  aL  <^e  Seit^ger  &  Peterson  (1985)  as  reportir^  a  reciuction  in  mean  y-axis  error, 
through  IraNr^,  of  from  <0.52mm  to  -OJZOmn;.  Did  this  mean  that  the  subjects  could  respond 
W^h  t^  much  accur«^  No,  Resokition  of  input  device  vras  <miy  3,2  mm.  The  data  shouid 
rep^y  be  kderpretted  as  meaning  that  hcfividusls  were  "on  targ^”  most  of  the  tote  but  occa' 
a^pfl^  were  orte  Ux^  ceil  off  1  in  15).  and  frtis  is  conaisterd  with  the  data  obtained  in 
that  S^y.  in  summary,  error  magnfUKtos  that  are  appredtddy  (ess  than  input  device  resotu- 
reiH^e  ^wciai  interpretation,  most  notably  when  resolution  of  the  Interface  is  compara¬ 
tive  coarse  when  compared  with  mean  error  (an  order  of  magnitude  dWerence  in  Beringer 
&  Peterson  study). 


At  aitemsis  way  of  examining  this  data  woidd  be  to  catagorize  responses  by  touch  urdts  arvl  to 
present  a  tisquency  dtetiibution,  eiuter  univariate  or  bivariate,  representing  the  frequencies 
w^  which  vadous  magnitudes  of  erro:  coukf  be  expected.  TNs  is  particularty  important  for 
devices  simnar  to  the  btfrared  panels  having  a  resoiuibn  of  ordy  1/8  indt  inasmuch  as  error 
canod  be  measured  on  a  fine  enough  scde  to  be  cor;sidt?r€rd  cor.t^nuous,  subsequent  evaluation 
should  treat  the  data  in  a  categorical  fashion.  Ihis  appeirs  to  have  been  o'^^kxdiad  in  a  number 
of  prei^ous  studies  (e.g.,  Berlr)ger  &  Peterson,  1985).  Wall  et  aL  came  ctcseat  to  tNs  in  their 
cwnutative  accuracy  documentation,  but  the  interface  device  they  used  was  not  of  the  type  re- 
quirbig  data  cdegc^atkin  (essenttaUy  continuous  measurement  for  the  purposes  described). 
The  siune  can  be  sdd  for  the  data  of  Berirtger  &  Bowman  (1989). 

i!  is  ^>parent  that  one  must  use  Afferent  devices  to  answer  (Merent  questions,  if  one  widtes 
to  answer  the  question  of  how  accurately  one  can  place  one’s  Anger  on  a  sloped  surface,  the  ap¬ 
propriate  mes^tremer^  device  may  weU  be  sor.iething  on  the  order  of  the  N(^-resolution  tMn- 
film  resistive  interlace.  If  one  vddies  io  determine  how  accurately  a  partictiiar  device  can  be 
used,  one  is  then  restricted  to  analysis  and  reporting  in  terms  of  that  unit's  resoiulion  capabU- 
ities. 


Interactions.  One  must  also  be  cautious  in  an  kiierprdational  sense  when  report^  main 
edecte  for  ttie  vailables  of  frderest  in  these  sfrKtes.  Tne  Had  studias  reported  a  number  of  slg- 
niflcant  2-  and  3-way  (and  ^  one  case  4-way)  interactions  but  main  effects  were  stfll  dis¬ 
cussed  without  being  tempered  by  the  presanrs  of  the  b^eractions.  The  interactions  were  not 
fuUy  exptalned,  either,  in  tNs  and  other  studies  the  result  is  that  reUabUity  of  the  main  effects 
is  clouded  and  one  is  often  left  to  sort  out  when  a  main  effect  wffl  go  one  drection  and  when  it 
wM  go  fihe  other. 

Range  effects.  There  is  also  the  notion  of  the  frange  effect*  and  the  posslbtoy  that  restric¬ 
tions  in  the  range  of  independent  variables  may  produce  'no-effect*  situations.  Previous  stud¬ 
ies  had  been  corKemed  aboid  die  accmacy,  in  very-hlgh-resobJtion  terms,  with  wNch  ind- 
viduals  coukJ  use  a  touch-input  device.  There  was  never  any  question  among  researchers  os  to 
the  efficacy  d  the  interface  for  menu  selection  usmg  reasor^y-sized  key  input  areas.  The 
HaH  study  did  examine  a  iimited  range  of  t£uge  size,  BmHed  to  b^ween  9.9  and  12.0  mm  in  frie 
y  axis.  This  range  was  not  Hkeiy  to  eUcH  the  potentially  intfu'esting  effect,  suggested  by 
Beringer  and  Peterson  (1985),  that  people  may  not  toui^  accurately  *..J}ecause  their  fingers 
get  in  the  way."  Thus  one  should  be  careful  in  interpretting  no-effeci  resotls  if  the  independent 
variable  ranges  are  restricted. 


il  i»  iTimimiurig  uiai  ottM  el  ui.  iCnii'io  oTi  Ofti  lOgui'idi-f'egai'u  fnaaii  eiiOi  Ot  - 


1.34  mm  In  y  ckrlng  the  first  exposure  to  a  comparativeiy  smaH  target  {+  character);  that 
eiTor  grew  to  -2.29  mm  in  posttest  (the  5th  blo^  of  tri^).  repiicaUng  findings  of  earHer 


stiKfies.  It  is  also  interesting  mat  mean  y  error  for  the  box-shaped  targets  varied  from  -1.5 
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'1c7t  rnfli  with  no  5l^ilfi<ant  ^ect  target  size.  These  data  fit  a  frer>d  #«t  Is  Increas 

«h  ma^ude;  ait  tariarmadiale  Uocks  shoM  a  higher  ms^jniiude  of  en-or  ^average  of  1.60). 
appears  to  ojdst  tn  thaw  data  the  posted  fatigue  effect,  observed  pTe\4aisiy, 
error  increases  mcniotontsaHy  over  trials. 

Qoe8tof» 

it  seaiDS  appropriate  to  exandne  a  much  wider  range  of  target  sizes,  spanr^ng  the  range  from 
cttedyobsoffed  by  the  fb^^erpad  to  deaity  visible  beyond  the  bounds  of  the  tegerpad.  This  is 
a  more  reasonable  a{^9roadi  as  a  wida*  range  tasks  are  now  represerded  and  one  can  truly 
examine  the  n^ttonsh^  between  desired  predsion  and  obtamed  acoir acy  (obtained  accuracy 
shouid  be  a  fimction  of  dedred  predslon  or,  more  succinedy,  parched  precision  require* 
inKte)^  This  todudes  the  case  where  view  of  target  Is  iod  just  prior  to  contact. 

tnatTLcHonat  set  i&  also  an  issue  here.  Hidi  et  aL  insbucted  subjects  to  touch  toe  centers  of 
toe  targeto  presented.  Thte  can  not  be  asdimed  to  be  standard  operating  procertore  for  a8  touch- 
panel  Mers.  p^cuiarty  novices,  to  the  most  absbact  sense,  erne  could  reason  toad  a  user  must 
‘toutto  toe  targrt*.  At  the  lowest  level  this  can  mean  that  sorne  part  of  toe  ftogerpad  must  con* 
tact  some  part  of  toe  target  The  next  higher  level  ci  inteipreta^  would  be  that  toe  contact 
point  mtai  be  'Vrithin*  the  togat.  wtoera  a  target  has  defined  boundaries.  At  the  highest  level 
one  sees  toe  requiremen!  as  meaning  that  toe  contact  point  must  be  centered  to  or  on  toe  target 
Each  of  toese  instnictionai  sets  sfiouid  produce  dHferant  predion  levels  in  ascending  order, 
tndrucbonai  set  may  rrot  appredabiy  affect  perfonnance,  however,  if  difrerent  tostructlons 
are  g^mn  the  same  totopreiadon  by  the  operator  (i.e.,  touch  toe  target"  being  toterpretted  as 
touch  the  center  d  toe  target"). 

Thv  prasent  studies  were  conducted  to  examtoe  some  of  toese  unanswered  questions,  most 
rKteatity  the  queSBons  of  target  size  variation  arKf  instructional  set.  ft  was  expected  that  varia¬ 
tions  to  target  size  should  produce  variations  in  pertormance  error,  responses  to  smalier  tar¬ 
gets  exfteit^  Knatier  mean  or  variable  error.  K  was  also  expected  toat  variations  in  in¬ 
struction  to  tte  operator  shouid  produce  changes  in  cutatoed  predston  or  varlabIBty  with  toe 
above  possible  interpretationai  KmHation. 


Metood 

Deskm/variabies 

A  mod^ksd  oentrd-composHe  design  (CCD)  was  used  to  assess  toe  effects  of  three  vadabies 
(target  iocf&ton  on  the  x  axis,  target  iocadon  on  the  y  axis,  target  size)  ai  five  ieveis  each.  The 
resulting  economy  to  this  scneering  design  reduced  data  cotiectton  to  23  points  from  the  125 
requked  for  a  stogie  replication  of  a  fuft-factorial  design.  This  economy  is  not  without  cost, 
however,  as  t^ioims  at  tte  extremes  of  the  experimental  space  are  sampite  once  per  replication 
wito  toe  ms^ority  of  points  betog  in  the  ceder  of  the  vartoble  space.  Target  size  varied  from 
6.'3  mm  to  13  mm  by  3.2nun  increments.  Target  location  was  equatiy  dstobuted  about  tho 
center  point  of  toe  dspiay  screen  with  a  spacing  of  16C  display  pixels  (40  mm)  between  target 
centers.  The  CCD  sampli^  strategy  allowed  ntoe  unique  combtoations  of  x  arrd  y  locatirm  to  be 
sampled,  loir  of  these  as  part  of  a  fractior>ai  factoria'  design.  Categorical  variables  Included  in 
tois  stody  included  gerxjer,  use  of  gloves,  and  presence/absence  of  visual  feedback. 

Agtarafats 

Bdh  tofrared  (Carroil  Touch)  and  resistive  (Elographics)  touch  parrels  were  used  during 
dda  coUection.  The  infrared  d^ce  was  mounted  on  a  14-lnch  fiat  tension-mask  monlto;  while 
the  resistive  device  was  attached  to  a  13-Inch  curved-surface  c.r.l  Each  was  driven/read  by  a 


dcicSpated  microprocessor  astern.  Given  the  mnnber  of  variables  addressed  ^d  space  Kmfta- 
ticm,  re8i8^v0^}anei  data  wHI  be  given  priority. 

Stibiftfitafl^fogedufe 

Twenty*fouf  right-harntod  und^graduata  students  {12  male,  12  female)  served  as  participants 
and  uaad  a  resistive  pa^  as  the  MertacB  device.  Each  was  sealed  before  the  appro* 

priate  dii^itay  in  an  a^^ustidiie  chab  sudi  dial  eye  height  was  located  on  a  tine  orthogortal  to 
display  cetitor  witfi  the  dit^y  within  comfortabte  reach.  Their  task  was  to  touch  the  square 
targets  appearing  on  die  rfispiay  as  quickly  and  accurately  as  possibie.  Instruction  to  tl^s  effect 
ware  preaented  as  text  on  the  display.  Each  participant  performed  four  blocks  of  m^s,  two 
wdb  to  bare  right  hand  and  two  with  to  gloved  ri^  totd.  Trials  were  (X'esentad  in  four 
bkxdcs  of  23  eor^tions  each,  to  order  of  these  corufidons  being  randomly  setected  Vteua! 
feedback  was  provided  on  dials  2  and  4  toicatkig  to  registered  input  point  relative  to  the 
intended  target  The  bare  tot  was  used  durktg  btode  1  and  2,  to  glove  being  worn  for  blocks  3 
and  4.  FdmMlng  data  coOection  eadi  Indhddua)  was  given  an  explanation  of  the  purpose  of  the 
experimerH  and  the  intended  application  (AH-648  ^ache  helicopter). 

Preliminary  Results 

Mutole  regression  for  the  x  and  y  error  meas^aes  (3  each)  prodiffied  values  of  ranging 
from  .13  {f!<at  x  contact)  to  .20  {last  y  contact).  Although  sig^cant  predictors  Induded 
gender,  feedback,  giovw,  and  scxne  bderestlng  second-order  effects  of  size  and  relative  iarg^ 
location  in  X  for  most  of  to  dependent  variables,  oryy  contact  duration  (R2«.52)  was  well 
prerttcted  by  its  combination  erf  predetor  variables.  TNs  was  repBcatad  in  the  second  study  for 
contact  duration  {R^.54)  and  log  reactlcn  tkne  {R2a.68),  wHh  group,  subject,  gender,  and 
grcH^  by  tiiai  accounting  for  the  vast  majority  of  to  varialion. 

Mean  errors  across  aU  x.y  iocalions  ranged  from  -(-Irmn  to  -I.Smm  with  typical  standard 
deviations  ranging  from  2mm  to  3.25mm  (for  both  x  and  y  error).  Raspondng  can  thus  be 
characterized  as  quite  accurate,  tt  appears  that  a  square  area  approximately  2Qmm  on  a  ^de 
wouid  adequately  account  (or  to  vast  majority  of  variation  found  In  this  examination.  This  area 
is  33%  smaller  in  eadi  eflmension  than  to  tactusrf  recognitkxi  field  recommended  by  Hall  et  al. 
(1988)  to  acoomf^h  to  same  accomodation  of  operator  variability. 

Reaction  times  (RT)  across  spatial  locations  on  both  to  intoed  and  resistive  panels 
foHowed  ekniiar  patterns.  Those  targets  closest  to  the  top  or  left-hand  side  of  to  dspiay 
produced  to  hxigest  RPs  arKl,  for  to  infrared  panel,  greatest  error.  Contact  duratkms  were 
reasonably  uniform  across  locations  (mean  •  130msec)  excepting  at  to  highest  target  on  the 
screen  where  contacts  were  of  shorter  duration.  RTs  in  to  first  study  ranged  from  504  msec 
to  652  msec.  Although  tore  were  some  statlsticaliy  significant  gender  effects  relative  to 
aoxjracy  and  response  time,  the  magnitude  of  tose  differences  was  so  small  as  to  make  them 
ncnsigniticani  bt  to  practical  sense. 

The  Instructional  variation  resirfl  was  Interesting  In  ttiat  mean  dfffereiices  in  x  and  y  error 
by  trial  and  group  were  of  vlrtuaJly  no  consequence  (shift  of  0.5mm  at  best).  Variation  in  y 
errof  did  decrease,  however,  for  the  experimental  group  overall  (first  point  of  contact:  s  = 

2,2  to  s  s  8.6  pixels;  from  3  to  2mm),  Similar  patterns  were  found  for  both  RT  and  contact 
durations.  RT  increased  signiiicanoy  over  trials  lor  ihe  experimetriai  group  (725,  855  and 
1048  msec)  as  did  variability,  while  RT  decreased  for  the  cor.troi  group  (611,  481,  and  485 
msec  respectively).  Contact  durations  decreased  slightly  over  trials  for  the  control  group  but 
did  not  change  substantially  for  the  experimental  group.  In  summary,  instructional  emphasis 
on  accuracy  made  subjects  more  datibwate  and  less  variable  in  their  responding  but  did  not 
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sub^anUaSy  rwtuc©  Was  error  (0.5  mm  or  so).  This  result  combined  with  subjective  reports 
(rom  sid»|6(ks  suggests  that  individuals  wm,  on  average.  Interpret  "touch  tho  target"  as  Touch 
the  center  of  the  target".  Irrstruction  to  do  the  latter,  In  most  cases,  is  thus  redundant 

Conclusions 

The  ilndirtgs  of  study  sug^st  that  the  tnost  frequently  used  "ke>’"  areas  In  menu  selection 
should  be  placed  near  the  lower  or  right-hand  borders  of  the  control/display  area  both  to 
minimize  activation  time  gmd  to  reduce  magnKude  of  e.-ror.  Thti  is  tnj©  for  right-handed 
activation  and  should  be  mirrored  in  ti'.s  x  axis  for  lefi^harided  activation.  ”ih«f  variable  error 
can  be  reduced  by  instruction  w£^  net  sutpristng,  but  the  imprcverr>ent  was  so  small  as  to 
suggest  that  most  Individuals  are  already  per/om-lvig  as  &cc.ufuioiy  as  is  pcssiWe  lor  them.  The 
^;parent  tailuie  to  accoimt  for  oi  the  vauiatlon  in  x  and  y  error  is  urKksubtecfiy  reliected 
in  the  fact  that  r^  extreme  values  of  x  and  y  position  were  used  (near  ctisptay  edges)  and  ti>e 
placement  of  most  targets  was  within  4  cm  of  cents,  screen  (8  cm  at  worst  possible  case).  This 
is,  In  fact,  the  good  nows,  suggesting  that  one  can  expect  some  unlfomilty  of  precision  across  the 
display  surface  with  this  type  of  interface.  It  is  also  clear  that  the  bias  error  fourrd  in  previous 
sturfies  of  infrared  devices  is  largely  absent  with  the  resistive  panel,  most  likely  as  a  function 
of  re<iiK»d  parallax.  This  leaves  variability  as  the  biggest  problem  to  be  dealt  with  and  use  of 
input  areas  at  least  20  rrtm  across  in  x  and  y  should  contain  the  vast  majority  of  intended  inputs 
for  the  rarrge  of  target  ^es  most  iikeiy  to  be  used. 
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Abstract 

To  datemine  the  navigation  perfotxiance  of  observers  using 
current  parallax  (two -station)  range  lights,  ve  measured  observers' 
ability  to  detedt  deviation  from  the  channel  centerline  and  motion 
acrpas  the  channal.  9*  found  that  the  tvo -point  fixed  range  light 
configuration  affords  a  reasonably  high  degree  of  sensitivity  in 
detenolning  lateral  position  and  motion.  With  tvo -point  flashing 
/.'ange  lights,  sensitivity  is  slightly  decreased  and  errors  in 
judging  direction  of  motion  are  significantly  higher  tiian  with  the 
fixed  lights.  ‘Training  or  experience  was  shown  to  improve 
riavlgaclon  performance,  and  judgments  of  motion  toward  the  range 
axis  were  significantly  more  sensitive  than  judgments  away. 


At  the  present  time,  the  U.S.  Coast  Guard  employs  a  visual  method  for 
indicating  to  a  vessel's  operator  the  correct  path  or  "range*  to  follow  while 
proceeding  along  certain  navigation  channels,  such  as  approaches  to  harbors 
and  within  rivers.  This  is  the  parallax  range  indication,  which  for  nighttime 
use  consists  of  a  pair  of  lights  positioned  on  the  range  axis  with  the  farther 
light  slightly  higher  than  the  nearer  one  (Figure  1) .  Vertical  alignment  of 
the  lights  indicates  that  the  vessel  is  pcsitioned  on  the  range's  longitudinal 
cencerline,  or  range  axis,  and  any  deviation  from  this  course  is  readily 
apparent.  As  a  baseline  for  comparing  performance  of  other  proposed  types  of 
range  displays,  experiments  were  conducted  to  measure  obser\'ers'  ability  to 
judge  their  motion  toward  or  away  from  the  range  axis  (dynamic  simulations), 
and  \diet±er  they  were  on  or  off  the  range  axis  (static  simulations). 

FRONT  REAR  (HIGHER) 


POSITION  OF  THE  OBSERVER 


Figure  Top  view  of  a  parallax  range.  W:  ch/innel  width;  Y;  distance  of 
observer  from  range  axis;  6:  horizontal  angle  between  the  lights. 


Method 


Thirteen  observers,  11  men  and  two  women,  ages  23  to  59  years, 
participated.  All  had  20/25  or  better  visual  acuity,  with  correction  if 
required,  and  varied  in  their  experience  as  psychophysical  observers.  Four  of 
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these  observers  also  participated  in  the  static  siEuiations, 

Apparatus 

The  range  configuraticns  were  simulated  on  a  Ramtek  9400  high  resolution 
color  display  system  driven  by  a  DEC  VAX  minicomputer.  Gi'servers  responded  by 
aeaTiS  of  an  auxiliary  key  pad. 

Displays 

Two  types  of  parallax  range  indicator  lights  were  simulated: 

o  Two'pcint  fixed,  consisting  of  two  lights  which  are  always  on  and  which  are 
vertically  aligned  when  viewed  from  the  center  of  the  cheinnel.  This  was 
simulated  as  a  pair  of  lights  0.6  arc  min  in  diameter,  separated  by  4.0  arc 
min  when  aligned.  When  viewed  from  off  center,  the  two  lights  are  not 
vertically  aligned  and  the  misalignment  Increases  with  increasing  distance 
from  the  center  of  the  channel. 

o  Two>polut  flashing,  similar  to  the  above  except  that  the  two  lights  are 
flashed.  The  upper  light  exhibited  an  Equal  Interval  6.0  flash 
characteristic  (3.0  sec  en  and  3.0  sec  off),  while  the  lower  light  showed  a 
Quick  Flash  characteristic  of  0.3  sac  on  and  0.7  sec  off. 

Observers  were  dark  adapted  for  5  min,  seated  in  a  dark  room  6  meters 
from  the  display  monitor.  The  monitor  screen  subtended  visual  angles  of  2.4*^ 
high  X  3.3^  wide  and  was  uniformly  illuminated  to  0.003  cd/m^,  equivalent  to 
the  night  sky  with  a  partial  moon.  The  stimuli  were  centered  on  the  screen, 
white  in  color,  and  had  a  luminance  of  100  cd/m^. 

Dynamic  simulations .  For  each  trial,  a  pair  of  range  lights  was 
displayed  in  a  configuration  corresponding  to  a  view  from  some  dlstf.r.ce  off 
the  range  axis.  After  a  variable  foreperiod,  the  bottom  light  begaii  to  move 
slowly  to  the  right  or  left,  simulating  a  vessel's  motion  across  the  channel. 
As  soon  as  the  observer  could  correctly  Judge  the  right-left  direction  of 
motion,  he/she  pressed  a  button  corresponding  to  that  direction.  When  the 
correct  button  was  pressed  the  distance  traversed  by  the  lover  light  was 
recorded  by  the  coisputer.  Trials  were  separated  by  a  two -sec  interval,  and 
errors  were  recorded  and  rerun  later  In  the  session. 

Eleven  starting  positions  were  chosen,  up  to  6.2  arc  min  right  and  left 
of  center.  The  lower  light  moved  at  9.3  arc  sec/sec,  which  was  imperceptibly 
slow  so  that  Judgments  were  based  on  the  position  of  the  lights  at  some  time 
after  the  start  of  the  motion.  For  typical  channel  configurations,  this 
corresponded  to  a  speed  of  2.6  to  11.5  knots  across  the  channel.  Performance 
was  measured  in  a  single  experimental  session,  which  consisted  of  one  trial  at 
each  starting  position  presented  in  random  order  in  both  left  and  right 
directions  of  motion,  repeated  over  three  blocks.  Tiie  session  thus  comprised 
66  trials,  and  lasted  about  50  min.  Observers  were  given  42  practice  trials 
prior  to  data  collection. 

Static  simulations.  The  two  lights  were  presented  in  one  of  nine 
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. '',^j£jCm£l£ura&io»s  vith  the  lower  li^ht  up  to  37.1  ere  sec  (0.62  ere  ain)  right  or 
of  the  range  axis,  they  'were  presented  in  random  order  once  every  4  sec 
for  0.2  sec.  The  (^server  was  required  to  press  one  of  two  buttons  on  the 
;..lteypad  corresponding  to  the  left  or  right  relative  position  of  the  lover 
li^t.  Sach  positim  was  presented  randomly  30  times  in  two  270- trial 
:  .-'sessions  which  lasted  18  min  each,  and  the  computer  recorded  each  response. 


Results 


figure  2  shows  the  average  thresholds  for  detecting  a  deviation  both  left 
and  rlg^t  of  start  position  for  both  the  fixed  and  flashixtg  range  displays. 
Threshold  is  the  average  deviation  from  start  position  required  by  the 
observers  to  correctly  judge  direction  of  motion  for  that  range.  The  mean 
threshold  for  the  flashing  dLlsp3.ay  is  0.12  arc  min  higher  than  for  the  fixed, 
but  this  difference  %ras  not  significant. 

A  repeated  measures  analysis  of  variance  (ANOVA)  was  computed  on  the 
thresholds  of  each  display  type  for  the  £ollo%ring  factors:  2  Directions  of 
Kctlon  <to  the  right  or  left)  x  11  Start  Positions  x  13  Subjects.  The 
direction  of  motion  effect  was  not  significant,  but  start  position  had  a 
significant  effect  on  thresholds  for  both  range  displays  (Fixed;  £  (10,120)  - 
4.43,  .001;  Flashing;  £  (10,120)  -  3.45,  <  .001).  Thresholds  are 

smallest  for  start  positions  at  or  near  the  range  axis  (start  position  of  0.0} 
and  increase  as  the  start  position  distaxue  increases  left  or  right  from 
center.  Ihis  means  that  observers  can  easily  determine  whether  they  are 
moving  toward  or  eway  from  the  range  axis  when  near  the  axis,  but  they  require 
a  greater  change  in  lateral  position  to  correctly  judge  their  direction  of 
motion  when  off  the  range  axis. 

The  interaction  of  direction  of  motion  vith  start  position  defines  the 
direction  of  relative  motion  (DRH)  effect,  toward  or  away  from  the  range  axis. 
This  interaction  was  significant  for  both  types  of  range  displays  (Fixed: 
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£  <10.120)  -  7.71.  £<  .001;  Flashing;  £  (10,120)  -  7.36,  2<  .001), 

iiulicacing  that  thresholis  for  judging  motion  coward  the  range  axis  are 
different  from  thresholds  for  motion  away  from  the  range  axis .  Figure  3  shows 
these  results  for  each  range  display.  Observers  were  better  at  Judging 
changes  when  the  direction  of  relative  motion  was  toward  the  range  axis  than 
sdien  it  was  away . 


TWO  -  POINT  FIXED  TWO -POINT  FLASHING 


left  right  left  right 

START  POSITION  (arc min)  START  POSITION  (crcmin) 

Figure  3.  Thresholds  for  relative  motion  (DRH)  toward  and  away  from  the  range 
axis  for  the  cwo-point  fixed  and  flashing  range  displays. 

Errors --that  is,  when  the  observer  responded  with  the  wrong  direction  of 
motion- *wcre  analyzed  in  a  corresponding  maiiner  to  that  for  motion  thresholds. 
For  the  fixed  display,  mean  error  percentage  was  11.1%,  and  for  the  flashing 
display  17.5%.  A  Nawman-Keuls  test  showed  these  were  significantly  different 
Cp  <  .05),  The  ANOVA  showed  that  the  effect  of  start  position  was  also 
significant.  Best  performance  was  near  tha  on-axis  position,  and  errors 
increased  with  distance  off  axis. 

Static  Simulations 

Data  from  the  four  observers  were  combined  and  probit  analyses  were 
conducted  on  the  2160  trials  from  the  two-point  range  display.  With  chance 
performance  represented  by  the  50%  probability  level  and  ceirtainty 
represented  by  100%,  a  protability  level  of  35%  correct  was  chosen  for  the 
practical  purposes  of  this  study.  Observers  could  judge  when  they  were  off 
the  range  axis  by  18.4  arc  sec  (0.31  arc  ain) .  Additional  pract.ice  and  a  less 
conservative  criterion  probability  level  would  likely  have  made  the 
performance  of  these  observers  approach  the  5  to  10  arc  sec  acuity  found  by 
Vestheimer  and  McKee  (1977)  in  similar  experiments. 

t\4 

W  A.  ^  W  V-4^  »  ^  W  S  i 


To  relate  the  measured  deviation  thresholds  to  accuracy  of  navigation  it 
is  necessary  to  convert  the  angular  measures  to  distances,  which  depend  on  the 
length  and  width  of  the  range  and  the  placement  of  the  two  range  lights .  The 
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r^nnanandatut ,  U.S.  Coasc  Guard  (1980)  has  specified  optimal  limits  for  such 
iraxige  conf igur acioiu ,  so  that  if  a  channel  wid^  of  152  a  (500  ft)  is  assumed, 
for  example .  ^e  can  see  the  navigation  accuracy  afforded  by  the  range 
displays . 

yhen  on  the  range  axis,  the  motion  threshold  for  the  fixed  range  lights 
is  11 . 9  m  at  the  end  of  the  channel  nearest  the  lights .  At  the  far  end  of  the 
ehannrl,  the  accuracy  drops  to  35.6  a  before  the  navigator  can  accurately 
perceive  lateral  direction  of  motion.  Out  near  the  edge  of  the  channel, 
performance  drops  off  somevdiat,  as  5ho%m  in  Figure  2.  The  motion  threshold  is 

15.3  m  at  the  near  end  and  45.7  a  at  the  far  end  of  the  channel.  This  is 
opposite  of  uhat  is  desirable  in  a  range  display,  which  should  afford  more 
sensitivity  as  the  vessel  approaches  the  edge  of  the  channel.  For  the 
flashing  range  display,  accuracy  is  somewhat  poorer  than  with  the  fixed 
lights.  For  chanriels  wider  than  152  m,  the  accuracy  is  proportionally  less. 

The  lateral  posi^'ion  threshold  determined  in  the  static  experiment 
appears  to  be  substancii-.lly  more  accurate  than  tlie  motion  thresholds.  The 
equivalent  accuracy  fo:  perceiving  which  side  of  the  range  axis  the  navigator 
is  cn  is  2.6  m  at.  the  n^rr  £:ul  of  a  152  m  vide  channel,  and  7.9  m  at  the  far 
end.  This  siisply  means  chat  it  is  uiucb  easier  for  the  navigator  to  tell  if  he 
is  on  or  slightly  off  ttie  range  axis  than  to  discern  whuther  he  is  moving 
slowly  toward  cr  away  from  the  axis.  Methodological  differences,  however, 
maite  this  task  quite  different  from  the  dynamic  task,  so  that  the  difference 
in  accuracy  may  be  overstated. 

Four  of  Che  13  observers  Ir.  the  dynamic  experiments  had  extensive 
experience  iu  making  fine  perceptiial  judgments.  To  determine  if  such 
experience  had  any  effect  on  motion  thresholdu,  we  compared  their  performance 
with  that  of  the  entire  group.  The  expsrienced  observers  had  thresholds 
averaging  0.5  arc  min  more  sensitive  clun  the  entire  group,  corresponding  Co 

4.3  meters  better  cccur^cy  at  the  near  end  of  a  152  m  wide  channel,  and  12.7  m 
at  the  far  end. 

These  results  describe  the  sensitivity  afforded  by  present  range  light 
conflguraCioriS  and  will  serve  as  a  baseline  to  allow  comparison  of  proposed 
single*  station  range  lights  for  evaluating  their  adeqtuacy  as  navigation  aids. 
Studies  of  three  single -station  ra.nge  lights  proposed  by  the  U.S.  Coasc  Guard 
are  in  progress.  These  findings  wi.'.l  be  reported  Ir  subsequent  presentations 
(Handler,  Laxar,  and  Luria,  1990)  and  NSMRL  reports 
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Prediction  of  Vccai.  Performance 
Using  a  Complex  Computer  Game 
Brittany  J.  Thurter 
David  B.  Porter,  D.  Phil 
US  Air  Force  Academy 

A  complex  computer  game  vas  adapted  to  be  played  using 
either  manual  or  vocal  input.  Twelve  male  and  twelve  female 
subjects  played  ten  games,  alternating  between  these  two 
control  modalities.  Initial  vocal  performance,  gender,  and 
familiarity  with  computer  games  were  the  strongest 
predictors  of  subsequent  vocal  performance.  Initial  vocal 
performance  was  a  much  better  predictor  of  subsequent  vocal 
performance  than  was  initial  manual  performance. 
Familiarity  and  gender  were  both  stronger  individual 
predictors  of  performance  than  either  initial  vocal  or 
manual  performance. 


Many  careers  attempt  to  select  "appropriate"  personnel. 
Adequate  selection  procedures  do  not  yet  exist  in  a  number  of 
these  areas;  one  important  example  involves  air  traffic  control. 
Sesearoh  is  being  conducted  to  uncover  the  best  predictors  of  job 
behaviors  in  both  the  cognitive  and  non- cognitive  domains  for 
this  complex  task  (University  of  Oklahoma 
Presently,  only  paper  and 
applicants,  even  though 


behaviors  in  both  the  cognitive  and  non-cognitive  domains  for 

et  al . ,  1 988 ) . 

pencil  tests  are  used  to  screen 
air  traffic  controllers'  tasks  are 
predominantly  vocal  (University  of  Oklahoma  et  al.,  '988).  This 

■'  viability  of  developing  a  voice  control 


the 


paper  addresses 
selection  task. 

The  speech  output  channel  is  only  one  response  option  for 
manipulating  complex  systems,  but  performance  in  this  modality 
determines  job-effectiveness  of  air  traffic  controllers.  In 
other  multiple-task  environments  speech  responses  can  also  affect 
overall  performance  (Vidulich,  1988).  Limited  research  has  been 
conducted  on  the  differences  between  vocal  and  manual  control  of 
r.  task  or  on  factors  that  predict  vocal  performance.  Vickens' 
(1984)  multiple-resource  model  separates  response  nodes  into 
vocal  and  manual  categories,  suggesting  the  two  roly 
resources,  thus  having  different  characteristics, 
to  this,  tasks  will  be  ’  ■■  * 


on  different 

- - —  —  Also  according 

best  performed  when  the  stimulus,  central 
processin'^,  and  response  are  all  compatible  (Vickens  et  al., 
1983).  This  model  suggests  that 
vocal  commands  will  oe  performed 
those  controlled  manually, 

Air  traffic  controllers  use  vocal  commands  to  change 
aircraft  flight  paths.  The  job  requires  this,  in  spite  of  the 
multiple-resource  model's  predictions  of  decrea3e4d  efficiency. 
Paper  and  pencil  testa  are  still  the  only  tasks  used 
individuals  for  entry  into  the  air  traffic  control 
people  vhc  perform  well  on  these  selection 
necessarily  those  who  would  perform  beat 
contrcllere.  Including  a  vocal  command 
selection  battery  sliould  enhance  the  val 


spatial  tasks  controlled  by 
somewhat  less  efficiently  than 


tc  select 
field .  The 
tasks  may  not 


task  as  part 
-dity  of  selection. 
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Although  there  ia  little  direct  empirical  evidence,  Vickens' 
(1984)  Eu 1 t ipl e- res ou re e  model  suggests  that  performance  on  a 
vocal  control  task  rather  than  a  manual  one  should  be  a  better 
predictor  of  subsequent  vocal  control.  Experience  and  motivation 
also  affect  performance.  One  study  on  motivation  (Oweek,  1986) 
found  that  high  achieving  beys  form  learning  goals  vbile  high 
achieving  girls  form  performance  goals.  The  type  of  goal  can 
affect  performance  on  difficult  tasks.  People  with  learning 
goals  consider  challenges  an  opportunity  to  learn,  while  those 
with  performance  goals  consider  them  an  evaluation  with  the 
strong  possibility  of  failure.  Subjects'  familiarity  with  the 
task  also  can  affect  the  amount  of  challenge;  lack  of  experience 
can  cause  a  task  to  appear  mere  complex  than  it  actually  is,  thus 
discouraging  those  with  performance  goals.  For  this  reason  less 
experience  with  computers  may  lead  to  lower  scores,  especially  in 
females.  Selection  of  a  computer  game  for  the  experiment  stems 
from  research  that  indicates  computer  games  increase  motivation 
and  provide  accurate,  objective,  yet  unobtrusive  data  (Gopher, 
1968,  Porter,  1986). 

This  experiment  was  designed  to  examine  differences  between 
vocal  and  manual  task  performance  and  to  identify  those  variables 
that  best  predict  vocal  performance.  Vocal  control  should  bias 
performance  toward  the  more  complex  task  and  manual  control 
should  increase  efficiency  on  the  simple,  uncertain  task, 
according  to  Wiokens'  (1984)  model.  Prediction  of  subsequent 
vocal  performance  should  be  more  accurate  using  previous  vocal 
control  performance  rather  than  manual  control  performance. 
General  experience  with  computer  games  should  also  be  a  strong 
predictor  due  to  subjects*  development  of  general  metacogni ti ve 
schemata.  Different  goals  of  male  and  female  subjects  could  make 
gender  another  important  performance  predictor  (Dweek,  1986). 

Method 

Twenty-four  cadets  (twelve  male  and  twelve  female)  from  the 
US  Air  Force  Academy  volunteered  for  the  experiment.  Their  ages 
ranged  from  18  to  21  .  None  of  the  subjects  had  previous 
experience  with  the  computer  game  used.  Subjects  played  the 
Whale  Game  using  both  manual  (keyboard)  and  vocal  control.  The 
Covox  voice  recognition  system  was  used  for  voice  control. 

The  game  required  the  subject  to  maneuver  a  whale  around  the 
screen  to  accomplish  two  different  sub tasks.  One  was  to  "eat"  a 
mass  of  plankton  that  moved  across  the  screen  in  a  random 
pattern.  The  second  subtask  was  to  cause  kayaks  that  came  onto 
the  screen  from  the  boundary  and  pursued  the  whale,  to  crash  into 
stationary  icebergs.  Both  tasks  were  worth  an  equal  number  of 
points.  Points  were  deducted  each  time  a  kayak  hit  the  whale. 

During  manual  control  trials  subjects  used  four  keys,  the  Q, 
E,  2,  and  S  to  change  the  whale's  direction.  For  voice  trials, 
si’bjec+.s  used  the  spoken  letters  U;  D,  L;  and  P  indicating  up; 
down,  left,  and  right.  The  manual  version  of  the  game  was 
modified  to  approximate  the  characteristics  of  the  vocal  version. 
The  game's  pace  was  adjusted  to  make  manual  and  vocal  games  the 
suiue  length  (characters  moved  about  every  1.5  seconds).  Pilot 
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'testing  indicated  a  voice  recognition  rate  of  about  90$,  thus  a 
random  *0$  error  rate  vas  incorporated  into  the  manual  version. 
The  plankton  and  kayaks  behaved  the  same  in  both  versions. 

Testing  took  place  individually  during  a  one  hour  and 
fifteen  minute  block.  Subjects  were  read  a  set  of  instructions 
and  then  watched  a  demonstration  of  the  manual  version.  Each 
subject  then  encoded  their  pronunciation  of  the  letters  U,  E,  L, 
and  E;  all  were  trained  to  a  minimum  recognition  criteria  before 
proceeding.  Each  subject  then  played  ten  three-minute  games, 
alternating  between  voice  and  manual  control. 

Sesults 

The  data  allowed  comparisons  between  voice  and  manual 
control  versions  for  both  subtasks.  Kanual  performance  on  the 
plankton  task  was  significantly  superior  to  voice  performance 
( t(25) “4 . 67 ,  p<.05).  The  kayak  scores  on  the  two  control 
versions  did  not  differ  significantly. 

Eegreasion  analyses  indicated  the  two  versions  had  similar 
task  structures  (Figure  l).  The  relationships  between  task 
components  did  not  differ  significantly  for  manual  and  vocal 
games . 

mou.  aunuL 


rigur«  1i  CauMt  R«laUea«jiJp<  totiMM.  Parfetaww*  faetors 
(IhHikara  ur*  eamUtlan  apcPriolMta) 

Voice  performance  was  divided  into  initial  (VPERFI  ;  and 
subsequent  (VPEEF2)  performance.  Several  measures  of  individual 
differences  were  regressed  against  this  criteria  to  identify 
which  were  most  predictive.  The  strongest  predictors  were  gender 
(gene),  familiarity  with  computer  games  (FAM),  and  initial  vocal 
performance;  together,  these  three  independent  variables 
explained  50$  of  the  variance  in  subsequent  voice  performance. 

VPEEF^  '  -.34(GEND)  +  .29(FAM)  +  .26(VPERFl) 

E-.50C  F=6.68  P<.005 

In  contrast,  when  initial  manual  performance  replaced 
initial  verbal  performance  in  the  equation  above,  its  beta  weight 
was  onlv  .14  and  th,e  overall  portion  of  the  variance  explained 
fell  by'  over  4$  (E*^-  .459).  So  significant  interactions  were 

found  between  predictor  variables.  This  suggests  that  these 
three  main  effects  were  additive. 


134 


Discuseioii 


The  ¥hale  Gaae  comhined  two  types  of  subtasks:  the  plankton 
task  was  simple  but  uncertain  and  the  kayak  task  was  complex  but 
certain  (Porter,  1986)^  Equal  priority  instructions  forced 
subjects  to  perform  both  tasks.  Higher  plankton  scores  on  the 
manual  version  might  reflect  subjects  adjusting  their  strategies 
to  take  advantage  of  greater  task-control  compatability.  The 
more  uncertain  task,  eating  the  plankton,  was  performed  better 
with  manual  control  than  with  vocal.  It  may  be  easier  to  respond 
to  uncertain  events  in  the  manual  modality,  and  since  subjects 
were  able  to  concentrate  on  either  the  plankton  or  the  kayaks 
this  difference  was  reflected  by  increased  plankton  scores. 

Eegresaion  analyses  of  the  two  control  versions  indicate 
similar  task  structures-  These  structures  are  the  implicit 
strategies  revealed  by  repeated  actions  across  games  and  subjects 
(Porter,  1966).  The  correlations  between  implicit  strategies  and 
overall  performance  were  not  significantly  different  for  vocal 
and  manual  control.  Similar  actions,  in  either  the  voice  or 
keyboard  game,  were  associated  with  higher  scores,  suggesting 
that  the  underlying  structure  of  the  two  versions  was  not 
affected  by  control  modality. 

The  three  primary  predictors  of  voice  performance  were 
gender,  familiarity  with  computer  games,  and  initial  vocal 
performance.  Initial  vocal  performance  was  expected  to  be  a 
strong  predictor,  due  to  practice  effects  and  drawing  on  the  same 
resources.  In  the  Whale  Game  subjects  were  biased  toward 
performance  goals,  by  watching  a  demonstration  game  and  then 
recording  their  scores  after  each  trial.  Inducing  performance 
(rather  than  learning)  goals  may  have  decreased  scores  for 
females  and  explained  the  observed  effect  of  gender.  Familiarity 
with  computer  games  was  a  separate  but  strong  predictor  of 
overall  performance.  The  additive  effect  of  gender  and 
familiarity  predicted  44. 5?  of  the  variance  of  criterion  scores. 
General  experience  with  computer  games  was  more  strongly 
predictive  of  vocal  performance  than  even  previous  vocal 
performance.  Perhaps  the  general  metecognitive  strategies 
developed  thi'ough  varied  experience  are  even  more  valuable  than 
initial  specific  practice  wtith  the  system. 

Initial  vocal  performance  was  a  stronger  predictor  of  vocal 
performance  than  was  initial  manual  performance,  as  was  expected 
based  on  Vickens*  (1984)  multiple-resource  model.  A  task  relying 
on  different  resources  than  the  criteria  (i.e.  the  manual  control 
task)  contributed  almost  nothing  to  the  prediction  of  performance 
after  gender  and  familiarity  were  considered. 

Improved  selection  could  be  accomplished  by  including  vocal 
as  well  as  manual  control  tasKs.  Spatial  vocal  tests  nay  be  more 
reflective  of  general  processing  resources  which,  in  turn,  are 
more  predictive  of  general  capabilities.  I n co rpo r t a t i ng  such 
tasks  into  the  selection  battery  would  increase  the  probability 
of  selectioag  the  best  personnel.  This  could  lead  to  reduced 
training  costs,  time,  dropout  rates,  and  improve  subsequent 
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per* ornance .  These  Denefits  apply  not  only  to  air  traffic 
controllers,  but  also  to  pilots  end  others  who  must  perform  some 
vocal  control  tasks. 

This  study  has  taken  an  initial  step  toward  discovering  more 
accurate  predictors  of  performance  on  vocal  tasks.  It  indicates 
there  are  performance  but  not  necessarily  structural  differences 
between  manual  and  vocal  control  versions  of  the  same  task.  The 
hypothesis  that  vocal  performance  would  be  a  better  predictor  of 
a  vocal  task  than  manual  performance  was  supported.  Analysis 
also  suggests  metacognitive  strategies  and  general  experience  can 
be  more  important  than  initial  performance  when  predicting 
computer  game  performance. 
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Abstract 


The  resident  U.S.  Army  Engineer  Officer  Advance 
Course  was  converted  for  home  study  via  asynchronous 
computer  conferencing  (ACC) .  Students  and  instuctors 
communicated  with  each  other  using  computers  at  home, 
thus  creating  an  "electronic  classroom".  Test  scores, 
completion  rates,  student  perceptions  and  costs  were 
compared  to  resident  training.  Results  showed  that: 

ACC  performance  is  equal  to  resident  and  costs  eure  less 
than  resident. 

Geographical  dispersion,  limited  training  time  and  civilian 
job  and  fairly  demands  make  travel  to  resident  schools  for 
training  and  education  difficult  for  the  Reserve  Component  (RC) . 
Not  only  is  it  a  hardship  for  soldiers  to  leave  jobs  and  family, 
but  their  units  are  unable  to  conduct  collective  training  when 
soldiers  are  absent.  In  addition,  training  soldiers  at  resident 
schools  has  become  so  costly  that  HQ  TRADOC  has  proposed  a  50% 
reduction  in  the  number  of  soldiers  traveling  to  resident 
training  by  2007  (TRADOC  PAM  350-4) . 

The  purpose  of  this  paper  is  to  summarize  an  investigation 
of  an  alternative  means  for  meeting  the  educational  requirements 
of  the  RC.  The  goals  are  to  (1)  develop  emd  test  a  new  training 
option,  using  asynchronous  coii^uter  conferencing  (ACC) ,  that 


These  data  are  summarized  from  Hahn,  H.,  Ashworth,  R. , 
Wells,  R. ,  Daveline,  K, ,  (in  preparation).  Asynchronous 
Computer  Conferencing  for  Remote  Delivery  of  Reserve 
Component  Training  (Research  Report).  Alexandria,  VA:  U.S. 
Army  Research  Instltuts  for  the  nehsvioral  and  Social 
Sciences. 

2  ,  , 

This  paper  is  not  to  be  construed  as  an  official  Department 
of  the  Army  document  in  its  present  form. 
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IJQt  ireguire  soldier&  to  leave  their  homes  and  units  and 
'  the  quality  of  training  typically  found  at  the 

school;  (2)  determine  the  cost-effectiveness  of 
developing  and  operating  the  ACC  alternative. 


Asynchronous  computer  conferencing  is  a  means  for 
oosHBUhioating  from  different  locations  at  different  times  (i.e., 
asyndbronously)  using  a  computer  network.  For  training 
pui^sesr  an  "electronic  classroom"  is  established  by  connecting 
all  students  with  each  other  and  the  instructional  staff.  A 
student  or  instructor  can  participate  in  the  classroom  from  any 
location  using  existing  telephone  lines  and  a  computer  equipped 
with  a  modem.  Students  can  work  together  in  groups,  ask 
questions  of  the  instructors,  tutor  their  classmates  or  share 
their  thoughts  and  experiences.  Instructors  can  direct 
individual  study,  conduct  small  group  instruction,  answer 
questions,  give  remedial  instruction  and  provide  exam  feedback 
to  the  students. 


Method 


gagtisipaatg 

Fourteen  RC  officers  (13  males;  1  femala)  took  Phase  III  of 
the  Engineer  Officer  Advanced  Course  (EOAC)  by  ACC  homestudy. 

For  ctuttparison  purposes,  performance  data  were  collected  from 
RC  students  taking  the  same  course  in  residence  at  the  U.S.  Army 
Engineer  School  from  October,  1986  to  June,  1989. 

The  instructional  staff  consisted  of  a  civil izm  full-time 
course  mzmager/administrator  responsible  for  the  overall 
operation  of  the  course  and  three  part-time  instructors.  The 
part-time  instructor  responsibilities  included  directing  group 
discussions,  remedial  instruction  and/or  monitoring  student 
progress . 


Course  Description 

Course  materials  consisted  of  Module  6  of  the  EOAC  (66 
progrzua  hours  of  instruction) .  Media  used  included  paper  based 
readings  and  problems,  computer-aided  instruction,  video  tapes 
and  computer  conferencing  discussion.  Topics  covered  were  Army 
doctrine  (e.g.,  rear  operations),  technical  engineering  (e.g., 
bridging,  flexible  pavements) ,  leadership  and  presentation 
skills.  The  program  of  instruction  was  identical  for  the  ACC 
and  resident  classes. 
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studuwit  was  provided  with  an  IM«  XT  computer  with  20 
Jiftrd  disk,  color  monitor  and  printer.  Software  and 
^cq^aewaro  loaded  on  each  computer  consisted  of;  (1)  a 

developed  course  management  system  and  communications 
;.|^^ge:;  (Z)  computed-assistod  instruction  and  tests;  (3)  word 
proc^sin$  package;  (4)  spreadsheet. 


commanication  software  for  asynchronous  computer 
conferencing  was  provided  through  U.S.  Army  Forum,  Office  of  the 
Pireetor  of  the  Army  staff.  The  host  computer  was  located  at 
Hai^e  State  university  and  used  the  CONFER  II  conferencing 
software  system. 


The  course  was  conducted  from  September,  1988  to  April, 

198S.  Students  were  mailed  all  their  computer  equipment  with 
\^itt«n  ass^nbly  and  operation  instructioits  and  course 
MterialB.  In  addition  they  were  provided  with  a  toll  free 
"hot  line"  telephone  nussber  for  resolving  hardware/software 
problems.  The  first  lessons  to  be  completed  were  self-^^nducted 
and  designed  to  familiarize  the  student  with  the  operation  of 
the  computer  and  software.  Scores  for  computer  training  were 
not  included  in  overall  course  grades. 


Part-time  instructional  staff  were  provided  the  same 
equipitent  and  software  as  the  students.  In  addition  they  were 
given  a  40  hour  training  course  on  operating  the  hardware/ 
software,  instructional  responsibilities  and 
teaching/motivational  techniques.  Instructional  staff  and 
researchers  met  together  to  conduct  this  training  using  a 
combination  of  lecture  and  hands-on  practice  with  the  computer. 


niere  were  four  types  of  data  collected;  (l)  test, 
practical  exercise  and  homework  scores;  (2)  pre-  and  post  course 
student  perceptions  of  their  amount  of  knowledge  on  the  course 
topics;  (3)  course  completion;  (4)  cost  of  converting  amd 
executing  the  course.  Comparisons  of  the  resident  to  the  ACC 
course  were  made  using  multivariate  analysis  variance  procedures 
for  a  two-group  design. 


Results 


As  sliovn  in  the  top  of  Table  1,  there  was  no  reliable 
difference  between  the  test  scores  of  students  in  residence 
versus  ACC.  A  comparison  of  the  Rtudent** *  self  ratings  of  their 
level  of  knowledge  before  and  after  the  coizrse,  showed  that  the 
ACC  group  had  significantly  greater  gains  in  their  perceived 
amount  of  leeuming,  as  shown  in  the  bottom  of  Table  l. 

Conplation  dat2>  shoved  that  95%  of  resident  students  completed 
the  course  compznred  to  64%  of  the  ACC  students. 
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Cost:  da^  were  coiaputed  sepeorately  for  (1)  converting  an 
existing  course  for  delivery  by  ACC  and  (2)  executing  each 
iteration  of  the  coiirse.  If  the  conversion  were  done 
by  vithin<-govemaent  staff,  then  the  cost  would  be  approxinately 
$296,100.  If  it  were  done  under  contract,  then  the  cost  is 
estimated  at  $516,200.  Start-up  costs  of  equipment  purchase  emd 
instructor  training  were  estimated  to  be  $73,100  for  vitbin- 
govemaent  emd  $96,000  for  contractor.  Costs  that  will  recur 
with  each  iteration  were  estimated  at  $234,400  for  within- 
government  and  $420,900  for  contractor. 


COURSE  rrERATIONS 


Fl<;iure  Relative  costs  of  EOAC  alternatives  over  10  course 
iterations . 


;  1  shows  the  total  course  conversion,  start-up  plus 

Jthe  recurring  costs  over  10  covirse  iterations.  Initially 
resident  and  ACC  (within  government)  are  similar  with  ACC 
(contractOtr)  costs  being  neaurly  twice  as  much.  However,  when 
'tthe  costs  of  conversion  and  execution  are  amortized,  ACC 
(contractor}  becomes  less  costly  than  resident  training  after 
tower  coarse  iterations.  After  five  iterations  ACC  (within 
government)  would  save  47%  and  ACC  (contractor)  would  save  6%. 

Cost-effectiveness  ratios  were  computed  by  combining  the 
cost  and  completion  rate  data.  The  ratio  was  greatest  for  ACC 
using  government  staff  (.64),  second  for  resident  training 
(.41),  and  lowest  for  ACC  using  contractor  staff  (.36). 


Discussion 

It  has  been  shown  in  this  report  that  there  is  a  cost- 
effective  alternative  to  sending  RC  soldiers  to  branch  schools 
for  resident  training.  Training  by  ACC  can  be  conducted  just  as 
effectively  and  for  less  money.  Thus,  this  technology  appears 
to  laeet  the  need  of  the  RC  to  complete  educational  requirements 
from  the  home  or  homeatation,  without  long  absences  from  the 
unit.  The  "electronic  classroom"  could  be  conducted  remotely 
from  existing  educational  institutions  such  as  the  branch  school 
and/cr  the  U.S.  Amy  Reserve  Forces  School  in  order  to  maintain 
standardized  instruction. 

Additional  research  is  needed,  however,  to  improve  the 
completion  rate  for  ACC  home  study.  Reztsons  for  dropping  out  of 
the  experimental  course  were  related  to  limited  time  due  to 
competing  activities  such  as  civilian  jobs  and  family.  A  means 
of  predicting  which  soldiers  eu:e  liXely  to  succeed  or  drop  out 
of  home  study  will  assist  Army  trainers  in  both  selecting 
students  and  providing  assistance  for  those  at  high  risk. 
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Abstract 

Past  research  has  demonstrated  a  relationship  between  undergraduate  grade 
point  (GPA)  and  training  and  job  perfonnance.  Further  evidence  su^ests 

that  ths  utidei^aduate  institution  attended  may  play  an  important  role  in 
influencing  that  relationship.  This  paper  presents  a  methodology  for  establishing 
empirically  the  effect  of  undergraduate  institution  on  the  predictive  validity  of 
C^A  Procedures  are  also  proposed  for  exploring  the  responsible  characteristics  of 
undergraduate  institutions  if  college  effects  are  detected.  Implications  for 
personnel  selection  systems  of  differential  GPA  validity  for  colleges  are 
discussed 


Thioi^out  the  military  and  private  secton  undergraduate  grade  point  average  (GPA) 
plays  an  important  role  in  job  selection  decisions.  This  measure  of  academic  achievement 
and  demonstrated  ability  is  widely  held  to  predict  employee  performance.  Recent  literature 
reviews  show  significant  but  modest  relationships  between  GPA  and  employee  perfonnance 
both  in  training  and  on  the  job  (e-g..  E^e,  Reck.  &  Harris.  19S9). 

An  issue  raised  by  the  use  of  GPA  as  a  personnel  selection  factor  concerns  pt^ible 
inequivalencies  in  the  grade  seals  across  colleges.  The  implication  for  employers  is  that 
expected  performance  would  vary  among  job  applicants  who  have  the  same  GPA  but 
graduate  from  different  colleges.  Research  on  this  issue  is  sparse  but  two  studies  suggest 
that  a  school  factor  may  mo^ate  the  GPA-perfonnance  relationship.  Dye  et  aL  (19S9) 
have  found  coneUtions  for  graduates  of  the  same  college  to  be  bi^sr  on  average  than 
those  for  graduates  of  different  colleges.  Further  evidence  that  college  characteristics  may 
influence  the  predictability  of  GPA  has  been  reported  for  Air  Force  officers  commissioned 
from  the  Reserve  Officer  Training  Corps  (ROTC)  program  (Barrett  &  Armstrong.  1989). 
Performance  prediction  was  improved  by  considering  a  quality  measure  for  the  officers' 
college  in  addition  to  their  GPA 

The  current  study  extends  the  investigation  of  the  college  and  GPA  issue  in  the  Air  Force 
to  a  second  officer  commissioning  source:  the  Officer  Training  School  (OTS)  a:  Lackland 
AFB.  TX  The  design  and  preliminary  findings  of  a  two-phase  study  of  the  relationship 
between  GPAs  awarded  to  cadets  graduating  from  different  colleges  and  their  subsequent 
performance  in  OTS  are  described  in  this  paper.  In  the  analytic  phase,  the  initial  focus  is  on 
the  validity  of  GPA  as  a  cadet  selector.  In  addition  to  simple  GPA  effects,  a  methodology 
for  examining  the  joint  effect  of  GPA  and  college  is  described.  If  differential  validity  for 
college  is  observed,  follow-on  analyses  have  been  designed  tc  explore  the  responsible 
variables.  In  the  explanatory  phase,  a  primary  interest  will  be  to  determine  the  relative 
contribution  of  student  etuollment  standards  versus  post-admission  experiences  to  the  college 
effect  Procedures  are  described  for  determining  whether  the  more  important  explanatory 
variables  reflect  the  talent  of  entering  students  as  opposed  to  the  quality  of  education 
offered  by  the  collegc. 

AnaJytic  Phase:  GPA  and  College  Relation^ips  with  Cadet  Performance 

OTS  cadets  are  selected  using  a  whole-person  approach  by  boards  composed  of  field 
grade  officers.  Previous  research  has  demonstrated  that  GPA  is  one  of  the  factors  related 


ji  <  jOI)  to  the  selection  board's  decisioa  to  admit  or  reject  a  candidate  (Cowan, 
ftSUtett.  Wegner,  1989).  Other  significant  factors  included  the  Air  Force  Officer 
Qua^fying  Test  <AFOQT%  degree  t>-pe,  and  prior  military  service  record 


One  goal  of  the  analyse  phase  was  to  evaluate  the  validity  of  the  GPA  selector  by 
dbtathihg  an  accurate  estimate  of  the  population  correlation  with  OTS  performance. 
.JBecajiSOrSafliple  size  affects  tte  reliability  of  the  estimate,  procedures  were  developed  to 
.ma^nuzO-  available  cases.  Fortber,  to  account  for  sample  hotuogeneity  produced  by 
prescreening  cadets  on  GPA  and  AK)QT,  restriction  in  range  corrections  were  applied  to  the 
correlation  coefficients. 


A  separate  series  of  analyses  was  designed  to  address  the  comparability  of  the  GPA- 
perfoimance  relationship  for  different  colleges  Graduates  from  colleges  nacion>wide  are 
considered  by  OTS  boards,  but  from  many  of  the  colleges  there  are  only  a  few  applicants. 
To  ensure  that  widiin-coliege  sample  sizes  were  large  enough  to  detect  effects  reliably,  it 
was  zmcessaiy  to  restrict  die  total  sample  to  selected  colleges. 

Method 


Procwhige 

I>ata  were  obtained  from  archival  personnel  files  maintained  on  Air  Force  officers.  A 
total  sample  of  11,619  cadets  who  entered  OTS  between  1982  and  1988  was  identified. 
Source  data  fox  the  primary  predictor  variables  were  the  cadets'  4'year  undergraduate  GPA 
anchored  on  a  4.0  scale  and  the  college  which  conferred  the''  baccalaureate  degree. 
Measures  of  cadet  performance  were  obtained  from  various  phases  of  the  12-week  OTS 
program.  Information  on  reason  for  terminating  training  was  used  to  generate  a  Pass/Fail 
dichotomy  reflecting  final  training  outcome  for  the  total  sample.  Eight  additional 
measures  of  performance  were  available  for  ^aduates  (N  »  9,858).  Final  Course  Grade  was 
an  overall  rating  of  academic  success  in  the  training  course  obtained  by  averaging  scores  on 
five  Consolidated  Written  Tests  (CWT  1-5).  The  CWT  measures  were  percent  correct  scores 
achieved  on  exams  covering  four  basic  areas:  defense  studies  professional  military 
knowledge,  communication  skills,  and  leadership  and  management  principles.  The  final  two 
measures  were  ratings  by  training  instructors  of  the  cadets'  overall  accomplishments.  The 
Officer  Training  Effectiveness  Report  ratings  were  reported  on  a  5-point  scale  (Outstanding 
s=  4,  Excellent  «  3,  Satisfactory  =  2,  Marginal  =  1,  Unsatisfactory  =  0)  at  the  6^  and  11* 
week  of  training.  Each  OTER  considered  performance  areas  including  leadership, 
adaptability  to  military  life,  professional  qualities,  communication,  and  judgment 

Analysis 

Simple  GPA  Effect  Summ^  statistics  were  obtained  to  describe  performance  on  the 
GPA  predictor  and  training  criteria.  Simple  (bivariate)  correlations  to  describe  GPA- 
performance  relationships  were  also  computed.  To  account  for  restriction  in  lange  on  the 
APOQT,  a  multivariate  correction  was  applied  using  test  results  for  an  unrestricted  sample  of 
3,000  examinees  (Skinner  &,  Ree,  1987).  For  GPA,  the  unrestricted  group  consisted  of  OTS 
applicants  (N  «  32,648)  from  1981  to  1988. 

Joint  GPA  and  College  Effect  To  examine  the  joint  effect  of  undergraduate  institution 
and  GPA  on  cadet  performance,  a  reduced  sample  was  identified  Subjects  were  restricted  to 
graduates  of  colleges  which  had  conferred  dej^ees  upon  20  or  more  cadets  A  case  count  of 
20  per  college  was  judged  to  be  the  minimum  necessary  to  detect  college  effects  reliably. 
A  total  of  5,150  cadets  from  102  colleges  met  the  requirement 

Multiple  regreision  analyses  are  currently  being  conductefl  to  test  a  urion  bynotheseS; 
following  the  generalized  linear  model  approach  described  by  Ward  and  Jennings  (1979X 
The  starting  model  is  designed  to  insure  a  relatively  complete  specification  of  potential 
joint  effects  due  to  GPA  and  college.  College  identity  is  measured  using  binary  coding  to 
form  categorical  membership  predictors  for  the  102  institutions.  In  addition,  the  starting 


model  coQiams  fiisi-,  second-,  third-order  polynomial  terms  for  GPA  and  their 
mreraciidfis  with  the  college  ptedictois.  Nonlinear  GPA  predictors  are  included  lo  account 
for  a  possible  relationship  with  expected  performance  that  is  ogival  ir.  shape. 

Reduced  models  have  been  designed  to  detect  ether  potential  relationships  for  GPA  and 
colleges  with  cadet  performance  that  are  less  complex  than  the  one  hypoAesized  by  the 
staiting  modsL  P<«sible  outcomes  are  an  interaction  between  GPA  and  college,  but  one  that 
^  a  simpler  functional  form,  either  linear  or  curvilinear.  Alternatively,  tfawe  may  be  a 
joint  but  noninteracting  effect  due  to  GPA  and  college  (with  either  a  linear,  quadratic,  or 
cubic  form).  In  these  cases,  expected  performance  would  differ  by  college  at  fixed  GPA 
valuas,  but  the  difference  per  unit  change  in  GPA  would  be  constant  The  least  complex 
alternate  outcome  would  be  an  effect  due  solely  to  GPA  (linear,  quadratic,  or  cubic)  or 
solely  to  college 

To  isolate  the  "best"  model,  pairs  of  models  will  be  compared  using  the  F-test  (p  <j01). 
The  same  series  of  analyses  are  planned  to  identify  the  most  appropriate  model  for  each 
criterion.  Raw  score  weights  derived  frem  the  least-squares  solution  will  be  used  to  compute 
predicted  performance  scores  These  results  on  the  magnitude  and  direction  of  significant 
effecte  will  aid  in  interpreting  for  example,  whether  any  differences  in  expected 
perfonaance  for  equivalent  GPAs  as  a  fuaction  of  college  are  appreciable. 

Explanatory  Phase:  Characteristics  Which  Account  for  College  Effects 

The  explanatory  phase  will  be  accomplished  if  results  of  the  analytic  phase  show  that 
^  lelatioaship  between  GPA  and  cadet  success  varies  by  college.  College  effects  will  be 
judged  to  be  present  for  a  criterion  if  the  corresponding  'best*  model  contains  significant 
information  about  college  membership.  The  objective  is  to  identify  variables  underlying 
the  effect  attributable  to  colleges.  A  primary  interest  is  whether  performance  variance 
accounted  for  by  colleges  is  due  principally  to  admission  standards  (college  selectivity)  or  to 
the  nature  of  academic  experience  ^educational  quality).  The  college  quality  indicator 
found  to  enhance  the  predictability  of  ROTC  cadet  performance  (Barrett  &  Armstrong 
1989)  incorporated  both  components  in  a  single  measure  using  poIicy-OTCcification  analj’sis- 
The  proposed  design  provides  procedures  for  partitioning  me  college  selectivity  and 
educational  quality  components  in  order  to  determine  the  unique  contribution  of  each  to  the 
college  quality  factor.  Further;  provisions  are  made  to  identify  specific  properties  of  the 
academic  and  instructional  opportunities  offered  by  colleges  that  may  account  for  an 
educational  quality  component 

Method 

Procedure 

The  unit  of  analysis  will  be  colleges,  as  specified  in  the  analytic  phase  (N  =  102). 
Measures  of  the  college  selectivity  and  educational  quality  components  are  being  obtained 
from  published  reports  which  rate  and  describe  colleges  (e.g,  American  Council  on 
Education,  1987>  To  measure  college  selectivity,  average  scores  of  the  entering  freshman 
class  on  national  suodardized  aptitude  tests  (Scholastic  Aptitude  Test,  American  College 
Test)  are  being  recorded.  Several  potential  measures  of  educational  quality  have  been 
identified.  Ratings  of  overall  academic  excellence  and  academic-athletic  balance  are 
available  from  a  survey  of  college  administrators  and  faculty  (Gourman.  1985).  Other 
measures  are  percentage  of  applicants  accepted,  percentage  of  graduate  students,  ratio  of 
students  to  full-time  faculty,  percentage  of  full-time  faculty  with  PhDs,  number  of  volumes 
in  library,  and  dollar  value  of  endowments,  grants,  gifts,  and  donations.  Data  to  be  used  as 
criteria  reflect  the  unique  contribution  of  the  102  colleges  to  the  prediction  of  OTS  cadet 
performance.  These  values  are  the  regression  weights  (b-weights)  for  the  college 
ujcmbetship  variabies  from  the  "best"  model  in  the  analytic  phase. 


^alysis 


Regression  analysis  will  be  used  to  explore  the  relative  contribution  of  college 
selectivity  and  educational  quality  measures  in  accounting  for  the  college  effect  The  b- 
wei^ts  for  colleges  will  be  regressed  on  college  selectivity  variables  only,  educational 
quality  variables  only,  and  noth.  Predictive  accuracy  will  be  compared  using  R*  and  F 
statistics.  Stepwise  procedures  will  also  be  accomplished  to  identify  the  most  salient 
indicalQis  among  the  available  educational  quality  measures. 

Results  and  Discussion  of  GFA.  Validation 

Descriptive  statistics  of  the  performance  criteria  in  Table  1  show  that  most  cadets 
passed  the  training  program  (86%)  and  achieved  mean  scores  in  the  low  90s  on  the  Final 
Course  Grade  measure  and  on  ihe  CWTs.  On  the  average  graduates  received  satisfactory 
ratings  on  the  6*^  week  OTER  and  improved  their  performance  to  an  excellent  rating  by  the 
11^  week.  Mean  GPAs  forOT.S  applicants,  entrants,  and  graduates  showed  a  slight  increase 
across  groups  (2.96  to  3.05),  but  the  standard  deviation  values  did  not  change  (.45  to  .44). 

As  shown  in  Table  1,  the  uncorrected  correlations  between  the  performance  criteria  and 
GPA  indicated  low  to  medium-low  positive  relationships.  The  lowest  correlation  was 
observed  for  the  Pass.'Fail  dichotomy  (i  =  .01)  and  the  highest  con-elation  for  Final  Course 
Grade  (i  =  .31).  All  correlations  were  significant  at  p  <.0i  except  Pass/Fail  and  the  6'**  week 
OTER.  Conelations  corrected  for  restriction  in  range  on  both  GPA  and  AFOQT  were  not 
appreciably  larger  (.03  or  less)  than  the  uncoirected  correlations. 

Results  of  the  preliminary  GPA  validation  arc  consistent  with  earlier  studies  (e.g,  Cowan 
et  aL,  1989)  lowing  the  utility  of  GPA  as  a  factor  in  the  OTS  selection  process.  For  many 
criteria  of  cadet  performance,  the  observed  relationships  with  GPA  are  statistically 
significant  and  are  judged  to  be  appreciable  as  well.  The  highest  gains  in  expected 


Table  1.  SusoDary  Statistics  of  OTS  Criteria  and  Correlations  with  GPA 


Criterion*  Keen  Sh  r 


Pass/Fall  .86 
Final  Course  Grade  91,78 
CVT  1  91.59 
CWT  2  91.67 
CVT  3  91.84 
CWT  4  90.90 
CWT  5  92.39 
OTER  6^*^.  Week  2.04 
OTER  Week  3,78 


“Pi»i/F*il  N  “  11,619;  oilwr  criteria  N-9,»38. 

“  carroeted  for  restriciioaoc  GPA  tnd  AFOQT. 

*  *p<X)l 


.01 

.03 

3.78 

.31*' 

.33 

5.24 

.19*  • 

.21 

5.18 

.22** 

.25 

5.06 

.21’* 

.24 

5.46 

.22** 

.24 

4.55 

.IB” 

.20 

.68 

.07* 

.08 

1.42 

.20** 

.22 

performance  per  one  point  increase  in  GPA  are  for  Final  Course  Grade  (about  points  on 
the  grade  scale  or  .75  standard  deviation  units)  and  for  the  11“*  week  OTER  (.7  point  on  the 
rating  scale  or  .50  standard  deviation  units). 
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an  unexpected  finding,  in  view  of  prior  research  suggesting  that  selection  board  members  use 
GPA  information  in  their  evaluations  of  OTS  cadets  Similar  corrections  of  AFOQT 
validities  for  the  study  sample  produced  marked  increases  Apparently,  the  boards  placed 


greater  emphasis  on  applicant  aptitude,  and  perhaps  on  degree  type  (technical  or 
nontechnicaiX  thereby  mitigating  the  anticipated  impact  of  sample  curtailment  on  GPA. 

Implications  for  Personnel  Selection 

An  advantage  of  the  proposed  methodological  approach  is  the  relative  ease  of 
applicatitm  by  other  government  and  private  sector  agencies.  Special  data  collection 
efforts,  such  as  convening  policy-makeis  to  judge  college  quality,  are  not  required.  Most  job 
applications  request  the  information  on  college  identity  needed  to  accomplish  the  analytic 
phase  and  explanatory  data  on  college  characteristics  are  readily  available  from  publi^ed 
documents.  However,  a  potential  limitation  is  that  the  accuracy  of  published  college  ratings 
is  unknown. 

If  college  effects  are  detected,  personnel  selection  systems  which  include  GPA  should 
account  for  the  moderating  influence  of  the  underlying  characteristics  of  undergraduate 
institutions.  If  college  selectivity  is  the  most  salient  characteristic,  selection  systems  which 
use  an  aptitude  measure  in  addition  to  GPA  may  already  be  capturing  the  performance 
variance.  Other  systems  which  rely  on  GPA  exclusively  may  find  college  selectivity  to  be 
an  aptitude  surrogate.  Either  of  system  might  also  be  improved  by  considering 
indicators  of  academic  and  instructional  experiences  if  educational  quality  is  shown  to 
moderate  GPA  predictability. 
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Institutional  and  Occupational  Paths  to  Ratantion 
Anong  United  States  Air  Force  Officers 


WiiliamH.  CummlnQS 
Os  fans*  SystSRiB  llsnagsmant  Col  lego 
Ft.  Bsivoir.  Virginia  22060 


Abstract 

This  study  sxaminsd  the  hypothasia  that  institutional 
reasons  for  joining  the  Air  Force— vice  occupational  raasons-'^ 
would  predict  career  retention.  Contrary  to  expectations,  survey 
responses  from  9,409  officers  demonstrstad  consistent  positive 
relationships  (£  <  .05)  between  retention  and  several  occupational 
reasons  for  Joining  (particularly  job  security  and  benefits), 
institutlona!  reasons  generally  failed  to  predict  retention. 

Officers  with  a  strong  desire  to  fly  or  prior  flying  experience 
were  poor  retainers.  Policy  implications  are  discussed. 

Moslios'e  institutional/occupational  (I/O)  thesis  of  organizational 
change  provides  an  Important  framework  for  understanding  many  current  trends 
in  the  armed  services.  Moskos  argues  that  “the  American  Mil itary  has  been 
moving  sway  from  sn  inat itutional  format  to  one  that  Inereaeingty  raaambles 
that  of  an  occupation  {Mokos  5  Wood,  1988,  p.3].*  Instltuttoris  arc  holistic 
organizations  baaed  on  service  to  others  and  a  sanss  of  'calling*  or  'duty,* 
requiring  e  near-^totsl  caninitment  to  the  organization.  Occupations,  on  the 
other  hand,  are  based  on  employment  practices  of  suppiy-and^deniand,  an 
exchange  of  wnployete’  time  for  money,  end  a  epeeisi let’s  job  orientation. 

Moskos  and  his  colleagues  offer  clear  evidence  of  the  gradual  transition 
from  an  institutional! y  based  to  an  occupat I  one  1 1 y  based  military.  Moskos 
further  outlines  three  consequences  of  the  Inst ■ tut  ions t-to-'occupat Iona  I 
transition:  (e)  a  tendency  for  empioyass  to  define  task  bounder  las  end 
standards,  (b)  replscament  of  intrinsic  motivation  with  sxtrinsic  motivation, 
and  (c)  an  undermining  of  military  profsseional iam.  The  consaquencea  may  be 
severe  for  the  military;  Troops  given  to  •  cost'bansfit  analysis  of  their 
occupstionei  behaviors  may  refuse  to  endure  hardship  and  make  the  extreme 
sscrificcB  sametimea  required. 

An  additional — and  general iy  unaxaminsd — question  is  the  affect  of  this 
occupational  trend  on  more  routine  organ Izat Ions!  behaviors;  job  performance, 
satisfaction,  absentee iam,  and  retention.  The  charter  of  the  ATC  Officer 
Selection  Study  Group  gave  ua  a  unique  opportunity  to  examine  the  effacte  of 
1/0  orientations  on  retention  in  the  Air  Force.  The  Study  Group  wee 
commtaslorHid  by  the  ATC  senior  leadership  in  October,  1988,  and  charged  with 
Identifying  attributes  of  officer  candidates  that  predict  euccass  (with  an 
emphsals  on  retention)  In  tha  Active  Duty  Air  Force.  The  Group  examined  a 
host  of  pereonnsl  aystem  and  survey  variabiaa  to  predict  long-term  retention. 
Included  were  eight  I/O  itama  that  provided  a  direct  teat  of  tha  effects  of 
officers’  initial  I/O  orientations  on  their  likelihood  of  retention. 

Moskos  sod  Wood  imply  thst  in-titutic.-.c!  ccrrsitmsnt  sheuid  yisiC  higher 
retention  rstea  than  will  occupational  conmitmsnt.  They  propose  that 
‘institutional  identification  foetsrs  greetsr  organizational  contnitment  and 
performance  than  does  occupstionei  {pp.4--5].'  Watson  k  Appel  (1986) 
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identifiBd  organizational  connitmant  aa  a  crucial  intarvaning  variabla  in 
aarvica  mamoars’  turnovar  dacisiona.  it  foilowa  that  i nat i tut iona t i y  oriantad 
officara  ahoutd  ba  our  baat  retainers.  However,  It  may  be  that  officers  with 
a  strong  occupational  orientation,  and  who  find  the  military  a  good  source  of 
employment  (good  pay  and  benefits,  security,  training,  etc.),  retain  bast. 
Therefore,  the  beat  retention  may  coma  frar  either  institutionally  oriented 
officers,  occupationally  oriented  officers,  or  those  high  on  both  dimensions. 

Method 


Subjects 

The  Study  Population  File  combined  elamanta  of  existing  Air  Force 
personnel  files  and  containad  racords  for  146.565  line  officers  with  a  Total 
Active  Ftderal  Military  Sarvica  Data  (TAFMSD)  of  196B-84.  From  this  file  a 
survey  sample  of  15,264  officers  was  drawn  by  atratifiad  random  sampling.  The 
stratification  factors  wars:  Cohort  Group  (1966-74,  1975-80,  and  1981-84) , 
Commissioning  Source  (USAFA.  OTS,  and  ROTO,  and  Utilization  Area  (Pilot, 
Navigator.  Engineer,  and  Other).  A  total  of  3,499  survey  packagea  (61. 6X) 
were  compiatad  and  returned  in  uaabla  form. 

Survey  Daaign 

The  study  group  constructad  the  Officer  Accassisn  Character ist ics  Survey 
to  supplamant  the  Information  in  the  Study  Pspolation  Filt,  in  order  to 
retroactively  measure  praaaiaction  and  pracommisnicning  data  as  aceurataiy 
possible.  Tha  survey  contained  93  itsms  ar,d  covered  eight  broad  areas : 
family  and  gaographica!  bacscground,  early  miiitary  exposura,  initial  entry 
dacision  factors,  previous  amptoymsnt.  hish  school  and  colisga  activities 
(both  athletic  and  nonathlst ic) ,  ksy  life  aventa,  flying  interest  and 
sxpsr lance,  and  initial  military  arpactat ions  and  axpariancaa. 

Tha  section  on  initial  entry  daoieion  factors  included  t$n  itams,  sight 
of  (itfhich  tapped  tha  officer's  initial  I/O  or  isntat  Ions.  Each  respondent  was 
ackad  to  rat#  (on  a  five-point  Likort-typa  scale)  the  ifriportar.ca  of  each  of 
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tha  following  factors  In  his/her  decision  to  enter  the 
Oppo.'tunity  to  serve  my  country  ( l.net  1  cut lonal  , 
Opportunity  to  make  tha  world  a  better  piece  (I) 
Continuing  a  family  tradition  of  military  sarvica 
Steady  vvork/job  sacurity  (Occupational,  0) 

Good  pay  (C) 

Better  job/promot Ion  opsortuni t lae  than  In 
Opportunity  for  training/education  (0) 

Good  bansfita  (0) 

itema  were  adapted  from  those  used  by  Saga 
1968),  rsphraaad  to  apply  to  the  officer's 
on  to  separate  anslyeee  for  each  item,  tha 
occupational  it«me  were  averaged  to  compute 


Air  Force: 
I) 

(I) 


c iv i ) ian  life  (0) 


These 

Wood, 
add  t  f 
f  i  ve 


and  Blair  (cited  in  Moskos  & 
initial  entry  decision.  In 
three  i  net  i  tut  ions  I  itome  anti 
an  overs! I  institutional 


measur*  (Ocorient) 


separata 

,  * 


meesure  (Insriant)  and  an  uvaraii  occupational 
Study  Otsion 

The  nwaauree  of  primary  interaet  were  the  correlations  of  tha 
and  ccTtibincd  i/0  meseurae  with  the  criterion  of  retention,  Becaueo  oi 
maturation  diffarenres,  this  criterion  was  defined  differently  for  each  cohort 
group.  Fcr  the  1665-74  Cohort  Group,  "eucesea"'  was  defined  ae  retantion  to  14 

.wia,  t,  t  vS  I  O'W,  Ml  OT  I  I  •  vail  7  uni  v  i  wi*  Vi  m'MO  /  ,  tiin  pO  fl  I  at  Mil  I  un  t  lie 

efficar  attrition  curve  stabilizes,  (Ninety-eevsn  percent  cf  officers  who 
reach  t.ha  U-ysar  i?ark  stay  to  rati’-arnant.)  Success  for  the  !675-60  Ccho-'t 
Group  was  defined  as  retention  to  6  years  (the  point  at  which  officers  nave 
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served  their  initial  corml tmenta,  plus  at  least  one  yaar),  since  thasa 
officers  have  not  yet  had  the  opportunity  to  stay  to  14  years.  The  1981-84 
Cohort  Group  was  deleted  from  the  present  analyses  Put  was  reserved  for  future 
analyses  as  these  offioars  mature  to  a  minimum  criterion  of  8  years. 

Results  and  Discussion 


Correlations  with  Criterion 

Table  1  presents  the  correlation  coefficients  of  all  eight  I/O 
variables,  as  well  as  Inortent  and  Ocorient,  with  retention.  These  results 
present  some  surprises.  First,  while  several  occupational  items  (including 
the  con^osite  measure,  Ocorisnt)  prsdict  long-tsrm  ratsntlon,  tha  institu¬ 
tional  items  general ly  do  not.  Only  ‘Join-Country"  and  ‘Join-World*  show  any 
oorralation  with  retention,  and  these  affects  are  specific  to  just  two  ceils 
of  the  analysis.  Tha  composite  measure,  Inoriant,  I Ikawies  fails  to  predict 
retention  for  any  group  other  than  1975-80  Pi  lota.  This  is  surprising  in  thst 
an  orientation  of  service  and  military  tradition  would  seam  to  predict  a  long¬ 
term  affiliation  with  tha  military  service.  However,  this  is  not  the  case. 

On  tha  other  hand,  tha  effect  of  occupational  orientation  is  both  robust 
across  itsme  and  calls  and — as  our  second  surprise — poaitiva.  Tha  compos  its 
maaeure  predicts  retention  for  ell  nonpitot  calls  but  one.  While  soma  Items 
hsva  littls  pradictivs  power,  others  (‘Join-Security,"  ‘Join-Benefits' 5 
predict  weil  for  most  greups.  For  the  nonpilot  utilization  erase,  a  strong 
occupational  orientation  predicta  a  propensity  to  stay  in  tha  Air  Force. 

These  findings  refute  our  hypothesis  that  institutional  lets  are  katpara 
and  occupational  lets  are  leavars.  Instead,  occupat ional lets  art  keepers  and 
the  i net i tut ional lets  show  no  strong  Inclination  either  way.  This  indicates 
that  nonpilots  who  enter  the  Air  Force  looking  for  e  good  job  find  whet  they 
ere  looking  for.  Although  they  do  not  etsy  because  of  inet i tut ional  reeaons 
such  as  dedication  to  duty  and  love  of  country,  they  do  stay  becauea  the  Air 
Force  is  a  good  place  of  employment. 

The  consistent  positive  predictions  produced  by  ‘Join-Security'  and 
'Join-Benefits*  are  particularly  telling  in  this  regard.  Nonpilots  (end  to  s 
lesser  extent  pilots)  ertio  joined  for  security  and  benefits  ars  keepers.  This 


TABLE  I 

Correlations  of  I/O  Variables  with  Retention* 


1966-74  Cohort  Group  1975-80  Cohort  Group 

Eng.  Nev.  0th.  Pi  I  . _ Eng.  Nav.  0th.  Pi  I  , 


INSTITUTIONAL  ITEMS: 

Inor iant 

♦  .08 

'Jo i n-Country* 

♦  .10 

■Joln-Wor Id' 

“Join-Trad  1 1 isn' 

-.08 

OCCUPATIONAL  ITEMS: 


Ocor iant 

♦ .  14 

♦.  1 1 

♦  .16 

♦.19 

♦  .16 

"Jo i n-Secur 1 ty' 

+  .25 

+  .17 

♦ . 22  +.11 

♦  .22 

♦.27  4.06 

Ju  i  ri*"r«v 

^ .  1 A 

.vv 

"Join-Better  Then" 

♦  .12 

'Join-Train ing" 

+  .16 

♦.10  -.17 

♦  .14 

-.13 

'Jo i n-Ban#f i ta" 

♦  .12 

1.14 

♦  .14 

♦. 19  +.07 

*0niy  significant  (p  <  .05)  findings  ere  reported 


TABU  2 

Corrsistions  of  'Flying  )nt«r«st'  Variablas  with  Ratantion* 


1986- 

fng. 

■74  Cohort  Group 

Msv.  0th.  Pil. 

1976-80  Cohort  Group 
Fna.  Nav.  0th,  Pll 

Join-Training 

■r.16 

♦.10  -.17 

♦  .14 

-.13 

Jcin-To  Fiy 

-.14 

-.15  -.10 

-.20  -.17 

-.11  -.08 

Pilot  Hours 

-.13 

-.11  -.09 

Pi  lot  Rating 

-.08 

-.15 

*On:y  aignificant  (£  <  .05)  findinga  ara  rapcrtad. 


finding  icn^l iaa  that  tha  Air  Foroa  ia  an  attractiva  organization  in  thaaa 
aapdcta  and  ia  maating  ita  off i cars*  naads.  On  tha  othar  hand»  tha  low 
eorraiationa  with  'Join-Pay'  impiy  pay  may  ba  taaa  important  than  aacurity  and 
banafits  as  a  motivator  for  long-tarm  ratantion.  Tha  maaaaga  for  Air  Fores 
paraonnal  policy  aaama  ciaar:  Initiativaa  and  proposals  that  thraatan 
aacurity  and  banafits  may  hurt  ratantion.  Pay  issuas  may  ba  lass  important. 

Contrary  to  tha  othar  utilization  arsaa.  pilots  showad  no  corraiation 
batwaan  Ocoriant  and  ratantion  for  aithar  cohort  group  (£  *  .04  and  .02  for 
tha  raapactiva  cohort  groups) .  Tasta  of  significant  dtffarancas  batwaan 
eorratatlon  coafficianta  indicata  that  pilots  ara  significantly  diffarant  from 
othar  utilization  araas  (with  tha  axcaption  of  tha  1976-80  'Other'  officers} 

In  this  regard.  Thus,  occupational  factors  da  not  aaaci  influantiai  in  aithar 
kaaping  pilots  in  or  driving  tham  out  of  tha  Air  Forca.  Tha  one  exception  to 
this  rula  ia  “Join-Sacur Ity.*  which  poaitivaly  pradicta  pitot  retention. 
Contrary  to  popular  logic,  occupationally  oriantad  pilots  do  not  laava  tha  Air 
Forca  simply  dua  to  tha  lure  of  lucrative  airline  Jobs:  Ocoripnt  ia 
uncorralatad,  rather  than  nsgativaty  eorraistsd,  with  pilot  ratantion. 

This  diffarancs  betwaan  pilots  and  other  officers  is  expiainsd  by  the 
'Join-Training*  corraiat ions  in  Table  1.  'Join-Training*  is  poaitivaly 
corralstad  for  three  of  six  nonpilot  cells  but  negatively  correlated  for  tha 
pilots.  Pilots  who  join  the  Air  Forca  for  training  ara  leavers,  while  othar 
officers  who  join  for  training  era  (for  tha  moat  part)  kaspars. 

Table  2  clarifies  this  trend.  Although  'Join-Training'  ia  nagativa  for 
pilots  only,  ‘Join-To  Fly*  and  othar  indicators  of  flying  intarast/axpar ianca 
ara  eonsistsntly  nagativa.  Officars  who  join  tha  Air  Forca  to  fly  or  antar 
with  flying  txpsr Ianca  ara  laavtrs— ragard lass  of  whathar  they  bacoma  pilots. 
Thass  data  point  to  a  curioua  conclusion:  Wharaas  tha  Air  Force  may  ba  a  good 
place  to  wtork  (as  svidanesd  by  tha  poaitive  correlations  with  tha  occupational 
itatna),  it  may  not  ba  auch  a  gcod  pieca  to  fly. 

Corralationa  Within  tha  I/O  Predictor  Sat 

To  axamina  tha  correlations  within  tha  I/O  predictor  sat,  wa  davalopad 
four  correlation  matricss,  breaking  tha  survey  aan^la  out  by  tha  two  cohort 
groups  and  pilot  vs.  nonptlot  utilization  srass.  Tha  resultant  matrices  rtvaal 
a  consiatant  and  fairly  powerful  sat  of  positive  correlations.  Of  the  112 
pairwise  correlation  coafficianta,  93  are  significant  (£  <  .05)  and  positive; 


only  eight  ara  nagat 

iva  (none 

significant) . 

Correspond  I ng 1 y , 

tha  corralationa 

catwaan  I  nor  lent  and 

Ocoriant 

ara  consistant 

1  y  pos i t i va : 

196S-74 

Nonpi lots 

L  " 

.23,  £  < 

.001 

1966-74 

PI  lots 

L  ■ 

.23,  £  < 

.001 

1975-80 

Nonpi lots 

L  * 

.04,  n.a. 

1976-80 

PI  lots 

r  * 

.12,  £  < 

.001 

-.C 
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Thes#  roults  cl««rly  r«futB  any  notion  of  a  nagativ*  ralationship  or 
tradaoff  betwaan  an  individual's  occupational  and  institutional  or iantat i ons. 
At  least  for  these  self-reported  reasons  for  entering  the  Air  Force,  there  is 
a  pos i t i ve  I/O  re! at ionsh ip.  These  findings  match  those  by  McCloy  and  Clover 
(3SB8},  which  also  failed  tc  detect  a  negative  I/O  relationship. 

These  findings  warrant  replication  with  diffarant  populations,  other  i/0 
items,  and  different  behavioral  aattinga.  If  supported,  they  have  a  ciaar 
practical  application:  Far  from  opposing  each  other,  i  and  0  orientations 
seem  to  compiament  each  othar.  An  individual  who  is  serving  for  (altruistic, 
duty-oriented)  institutional  reasons  may  aiso  serve  for  (relatively  selfish, 
calculated)  occupational  reasons.  As  a  conssquence,  initiatives  by  senior 
leadership  to  curb  the  rising  tide  of  occupationally  oriantad  “CBreer ism"  and 
replace  it  with  institutional  values  should  be  racons idcrsd. 

impi icat ions 

These  findings  have  several  clear  imp  I i cat i ona ,  both  for  the  research 
conmunity  and  for  salact ion/parsonnal  policy: 

1.  Occupational  I y  oriented  nonpilot  candidates  will  most  likely  be 
keepers,  particularly  thoaa  attracted  by  job  sacurity,  bsnafita,  and  tha 
opportunity  for  training. 

2.  Pilot  candidates  with  a  strong  dasire  to  fly  (as  avidancsd  by  sslf- 
raport  or  prior  flying  axparisnea)  will  ba  poor  retainers.  Likewise,  pilot 
candidates  interested  primarily  in  tha  Air  Force’s  treining  opportunities  will 
be  poor  retainers. 

3.  Personnel  initiatives  that  threaten  benefits  end  job  security  will 
impeir  retention. 

4.  Selection  end  treining  initiatives  that  attempt  to  replace 
‘careerist''  orientations  with  inetitutionai  orientations  should  be 
reconsidered.  Institutional  end  occupational  orientations  appear  tc  be 
complementary,  rather  than  centred ictery .  Furthermcr*,  an  occupaticna! 
orientation  positively  predicts  higher  retention. 
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selection  for  Retention: 
fiaport  of  tho  ATC  Officer  Sotoction  Study  Group 


Wi  1  i  iam  H.  Cunnings 
Dstsnsc  Systsrns  Msruigsswnt  Colisgs 
Pt.  Btivoir,  Virginia  22060 


Abstract 

This  study  axamiruid  a  cohort  fils  of  146, SOS  offiesrs,  with 
survay  rasponaas  from  9,408  of  thasa  officars,  to  datar^oina 
attributas  of  officar  candidatas  that  predict  ratontion  in  tha 
Activa  Duty  Air  Forca.  Variablas  that  raiiably  (£  <  .05)  pradict 
ratantion  includa;  aourca  of  comniasion,  col laga  cost,  military 
ordar  of  marit,  raaaon  for  joining  tha  Air  Forca.  pracoont  Isa  toning 
pitot  rating,  and  family  background  (ineone,  mobiilty,  military 
background,  and  aoc ioaconomic  atatua).  Ragraaaion  modals 
auccaadad  in  accounting  for  12  to  72  parcant  of  tha  variance  in 
ratantion  behavior,  dapanding  upon  tha  apacific  group  studied. 

Careful  acraaning  and  aalaction  of  appi icantc  is  a  traditional  concarn 
of  the  military  sarvicas.  Howavar,  svsn  tha  most  capable  candidate  may  have 
Itttia  value  for  a  retant ion-or lantad  forca  (such  as  the  Air  Force)  if  his/her 
I  ikai  ihoed  of  ca.‘'aar  ratantion  is  low.  in  addition  to  producing  caraar' 
oriented  warriors,  acientiata,  and  tschnieiana,  ‘cha  Air  Forca  fraquantly 
bscomat  a  valuabia  training  conduit  for  civilian  industry.  This  problam  has 
bacoeia  particularly  aarioua  for  the  pilot  force  in  recent  yeers.  it  ia 
clearly  in  tha  aarviea's  Intaraat  to  sceeas  candidates  with  known  ratanticn 
character  let los — moat  often  those  who  are  likely  “katpara.* 

On  tha  other  hand,  a  pr lor i  identification  of  candidates  I ikaty  to  bt 
kaapsrs  is  no  aaay  ma'tar.  The  voluminous  turnover  iitaraturs  provides  only 
limited  information  on  , resataction  predictors.  Tha  primary  focus  of  the  work 
on  turnover  has  bean  postaatection  predictors  (a.g.,  Gibb,  Nontasak,  &  Doigin, 
1966;  Watson  I,  Appal,  1966),  although  acme  studies  examined  prasalaotion 
predictors  fo*'  populaticna  vary  different  from  officer  candidates  (Finatuan  & 
Allay,  1983;  Ward  6  Tan,  1965).  Furthermore,  moat  studies  axaminsd  relatively 
short-term  turnover  (Cook  6  Morrison,  1983;  Shenk,  Watson.  5  Hazsl,  1873)  or 
turnovsr  intant  (Dunn  5  Feller,  1983;  Gibb  ct  al.,  1986),  rather  than  actual 
turnover , 

Tha  senior  leadership  of  Air  Training  Cooynand  addrassad  this  problem  to 
tha  Officer  Selection  Study  Group  in  October,  1986.  The  Group's  chartsr  was 
to  identify  attributes  of  officar  candidates  that  predict  success  (with  an 
emph&aie  on  ratantion)  in  tha  Activa  Duty  Air  Force.  We  had  full  access  to 
and  cuoperation  from  the  Air  Force's  paraonnsi  and  scientific  conniun I t iaa. 
Through  thasa  rasourcan,  we  had  accasa  to  all  avaiiabic  Air  Farce  paraonnai 
fiiaa,  as  wail  as  tha  technology  to  develop  naw  data  collection  instruments. 

An  imports:)!  qualification;  howavar ,  waa  that  our  final  report  waa  dut  within 
seven  months,  for  aubmiasion  to  tha  Air  Force  aanior  taadarship.  This 
combinat icn  of  maximum  acuass  to  rasourcaa,  maximum  visibility,  sno  minimu,Ti 
turnaround  time  quickiy  aatsbiishad  tha  project's  direction. 
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Method 


The  beetc  etudv  plan  wee  to  examine  descriptive  statistics  and  build  a 
ouitipls  linear  regression  node!  to  predict  retention  behavior  from  ell 
avstlebie  prseoRmissioning  ettributes  of  officer  candidates.  Data  sources 
consisted  of  existing  data  files  and  a  survey  created  specif iceliy  for  this 
study.  Seesust  the  Air  Fores  sceesssa  officers  front  a  variety  of  backgrounds 
end  eopioye  them  in  a  variety  of  duty  areee.  the  study  wee  stratified  by  both 
comRuseioning  source  end  utilization  category.  The  study  «a«s  further 
stratifisd  by  data  of  entry,  since  the  basic  data  file  covered  a  wide  span  of 
entry  dates  (1985-88). 

Study  Popuieticn  File 

The  Study  Population  File  eonkitned  aientents  of  existing  files  and 
contained  records  for  149.568  officers.  Thsse  records  were  sxtracted  from  the 
Air  Force  Human  Reaouroea  Laboratory's  (AFHRL)  Officer  Historical  Profile, 
with  the  following  criteria:  tine  officer:  commieeionad  through  OTS,  POTC,  or 
USMFA;  Total  Active  Federal  Military  Ssrvice  Date  (TAFWSO)  of  1995-64,  and 
currently  on  active  duty  or  with  a  variflebia  eeperat I  on/ret iramant  data.  The 
Officer  Historical  Profile  contained  three  oetegorics  of  dote  svuiJebie 
through  the  personnel  syatem:  (a)  entry  data,  such  ee  home  of  record,  source 
of  coimuseion.  ethnic  group,  aex,  and  marital  atatua;  (b)  duty  history,  such 
as  aagigneient  history,  prometion  record,  and  Officer  Effect tveness  Report 
(OER)  date:  and  (c)  aaparation  data,  auch  as  aaparation  data  and  reaaon. 

Thta  extract  forenad  the  core  of  the  cohort  data  baas  and  defined  the 
study's  population.  The  following  additionai  data  eiauents  ware  extracted 
from  supporting  files:  (a)  standardized  teat  acoras,  including  Air  Force 
Officer  Qualifying  Teat  (AFOOT),  SAT,  and  ACT  ecorae,  as  available;  (b)  USAFA 
application  data,  for  ell  Academy  greduetee;  (c)  edditionei  personnel  syetam 
data  (aiemante  not  avallabla  through  tha  Officer  Historical  Profile), 
including  undergraduate  academic  institution,  AFROTC  detachmsnt.  and  overseas 
tour  data;  end  (d)  college  dets,  to  categorize  major  colleges  by  coat, 
selectivity,  religious  affiliation,  size,  and  athletic  conference. 

Survey  File 

Although  the  supporting  fllas  providsd  a  wealth  of  background  data,  they 
were  not  deetgned  to  predict  retention.  Conseouently.  tha  varieblae  from 
these  flies  ware  unlikely  to  account  for  an  appreciable  amount  of  the  variance 
in  retention  bohevior.  Therefore,  the  study  group  constructed  the  Officer 
Accession  Character i sties  Survey  to  retroeotively  measure  preselection  and 
pr ecommi as i on ing  data  as  aecursteiy  as  poasibis.  Tha  survey  contained  93 
itama  and  covered  eight  broad  sreaa;  family  end  geographical  background, 
early  military  expoaura.  Initial  antry  decision  factors,  pravioue  smploymant. 
high  school  and  cot  lags  activities  (both  athletic  and  nenethlst ic) .  key  life 
events,  flying  Interest  snd  experisnes,  and  initial  military  axpectations  and 
axpsr lances.  Most  items  took  the  form  of  biodata  or  background  information. 
Mhers  possible,  questions  referenced  objective,  verlfisbie  events,  in  order  to 
aid  recall,  increase  accuracy,  end  facilitate  Imptsmentatlon.  Of  a  total  of 
15,264  aurvay  packegas  mailed  out,  6,409  (61. 6X)  were  returned  in  ueeble  form. 
Study  Oeelon 

Beceuea  of  maturation  differences,  the  criterion  for  eueceas  wee  defined 
differently  for  each  cohort  group.  For  the  1966-74  Cohort  Group,  ■eucceae" 
was  defined  as  retention  to  14  years  of  Total  Active  Federal  Military  Service 
(TAFMS) .  the  point  at  which  tha  officer  attrition  curve  atebilizte.  (Ninaty- 
eaven  percent  of  officers  who  reach  the  14-year  mark  stay  to  retirement). 
Success  for  tha  1975-60  Cohort  Group  erne  defined  ec  retention  to  8  years  (the 
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point  at  which  ail  off  tears  hava  sarvad  thair  initial  coorni  tment,  plus  ona 
yaar),  sines  thasa  off i cars  hava  not  yat  had  tha  opportunity  to  stay  to  M 
yaara.  Tha  198t-84  Cohort  Gro'jp  was  dalatad  from  the  prassnt  ana i yeas  hut  was 
raaarvad  for  future  analyses  as  these  officers  mature  to  a  minimum  criterion 
of  8  years. 

Tha  Study  Population  Anal  yeas  used  tha  foli  cohort  population  of  146,566 
officars  but  wara  rastrictad  to  Study  Population  Fiia  data.  Thaaa  analysas 
wara  stratified  by  Cohort  Group  (1966-74  and  197G-80)  ,  (^ocmiissioning  Source 
(USAFA,  OTS  Non-Prlor  Service.  OTS  Prior  Service,  end  AFROTC) .  and  Utilization 
Area  (Pilot,  Navigator,  Eng i near,  and  Othar;  32  calls  total).  Tha  Comb i nad 
Anal vsea  used  both  Study  Population  Fiia  data  and  Survay  File  data  but  ware 
restricted  to  the  survay  sample  of  9,409  officers.  These  anaiyaas  wars 
stratified  by  Cohort  (^roup,  Coomies ioning  Source,  and  Utilization  Area  (Pilots 
snd  Nonpitoti  only,  dua  to  tha  smaller  number  of  subjects  availabis  on  ths 
survsy  file).  Combinsd  Anslysss  were  omittad  for  tha  1965-74  OTS  Prior 
Service  Pilots,  dua  to  ths  unexpectedly  amel i  number  of  eubjecte,  49,  in  thie 
ceil.  This  deletion  left  15  cells  In  tha  Combined  Analysee. 

Reeulte  and  Diecuesion 

Tan  typea  of  results  are  presented  hare:  (a)  affects  of  ksy  predictor 
variables  on  retention  and  (b)  results  of  tha  multiple  linear  regraesion 
model ing  efforts. 

Key  Individual  Predictors 

Each  variable  balow  ia  idantitiad  as  aithar  a  population  (P)  variable, 
based  on  tha  full  cohort  population,  or  a  survay  (S)  variable,  based  on  tha 
eurvay  sample.  Tha  .05  significance  level  is  used  for  reporting  findings  in 
all  cases.  As  a  basal ina,  the  overall  retention  levels  were: 

1986-74  Group  1975-80  Group 
Study  Population  34. 3X  67. 6X 

Survey  Sample  35. 6X  66. 6X 


Retention  wee  significantly  higher  than  averega  for: 

1.  (P)  Navigators,  followed  by  pilots,  enginears,  and  othar  officars, 
respect ivaly. 

2.  (P)  OTS  Prior  Service  gradustaa.  followed  by  Academy  graduataa, 
AFROTC  graduates,  and  OTS  Non-Prlor  Sarvica  graduatae,  raspoct ival y . 
Among  OTS  graduates.  Prior  Sarvica  graduataa  with  up  to  eight  years 
prior  enl istad  tima  surpassed  Non-Prlor  Sarvica  graduataa. 

3.  (S)  Officers  whose  parents  were  military  members  or  btua-coiiar 
workara,  as  opposad  to  whita-collar  Nwrkara  or  sa I f-smpt oyad . 

4.  (S)  Officars  whoaa  parants  ware  career  enlisted  mambara,  as  opposad 
to  caraar  officars. 

5.  (P)  Graduates  of  moderate-cost  (95000  par  year)  collages.  Graduates 
of  high-coat  collagas  (97500  or  more  per  yaar)  had  significantly  I ower 
ratantion. 

6.  (S)  Officers  whoet  psrente/fami Mae  had  higher  mobility. 

7.  (S)  Officars  who  statad  they  jelnad  tha  Air  Force  for  job  sacurity. 

6.  (P)  Academy  graduataa  who  wara  higher  in  tha  Military  Order  of 

liar  it. 

9.  (P)  AFROTC  engineering  graduates  working  in  non-ang inaar Ing 

apacialtiaa  (aa  opposad  to  those  working  In  eng  I  near ing  spec i a  1 1 i aa . ) 


Rattntion  was  sifinif icsntly  !owar  than  average':  for: 

to.  (S)  Officars  from  highai — incoma.  more  higi-iy  aducatad  familtas. 

11.  (5)  Officars  who  statad  thay  joined  the  A  -  Force  for  training. 

12.  (S)  Officars  who  had  a  civilian  pilot  rating  or  large  number  of 

flying  hours  prior  to  entering  their  comrrias ic"> i ng  program. 

Among  factors  that  had  1 ittia  or  no  predict iva  valua  in  retantion  (often 
contradicting  cotimoniy  held  assumptions)  wars; 

14.  (P)  SAT  and  AFOOT  scorsa. 

15.  (S)  Col  lags  6PA  (although  high  achoo!  class  standing  corraiatad 
nagativaiy  for  Nonptiots). 

16.  (S)  High  school  and  collage  activities  (sports  and  non-sports). 

17.  (S)  Scouting  axparisnca  (including  Eagis  Scouts). 

16.  (S)  Work  history  (including  nawspspar  dallvary  axparianca). 

19.  (S)  (iaographic  ragion  (at  time  of  high  school  gradual,  ion)  . 

20.  (S)  Kay  life  events  (i.a.,  age  at  first  data,  traffic  ticket,  etc.). 

Ragraaeion 

Study  Population  Analvaaa.  A  aaparata  ragraasion  mooai  waa  constructed 
for  each  of  the  16  calls  (four  coonissioning  sourcss  X  four  utilizstion  arass) 
for  aech  cohort  group.  The  Study  Population  File  sentalnad  savanty-aavan 
candidate  variables.  For  the  1965-74  Cohort  Croup,  R'  vsluas  ranged  from  .006 
to  .023,  with  two  cal  la  failing  to  generate  a  modal  (l.a.,  no  variables 
significantly  predicted  retantion).  For  the  1975-60  Cohort  Group,  the  R* 
values  ranged  from  ,009  to  .034.  These  vstues  are  obviously  quite  lew,  at 
best  account  I  ng  for  some  three  percent  of  the  variance  ir.  retention.  These 
results  Indicate  that  the  pracoramissloning  data  currently  collected  by  the 
pereonnal  system  are  insufficient  to  enhance  currant  selection  procedures  and 
improve  retention.  Furthermore,  they  ere  ineufficisnt  to  even  accurately 
predict  retantion  trends. 

Combined  Analyses.  A  separate  regression  modal  was  constructed  for  each 
call  in  the  1965-74  Cohort  Croup  (7  celts)  and  1975-80  Cohort  Croup  (8  calls). 
For  ths  1965-74  Cohort  Group,  the  R*  vatuas  rangad  from  .193  to  .660,  with  a 
median  R*  of  .246.  For  the  I976-80  Cohort  Group,  the  R*  values  ranged  from 
.230  to  .962,  with  a  median  R*  of  .422.  (The  .660  and  .962  valuta  are  basad 
on  two  OTS  Prior  Service  celts,  with  high  retention  rates  end  relatively  small 
cel  I  sizes.) 

The  regression  modeie  were  cross-validated  by  a  jack-knifing  procadurf', 
in  which  each  subject  wee  sequentially  removed  from  the  sample,  a  new 
regrtesion  modal  constructed,  and  the  modal  used  to  predict  that  subject's 
retantion  behavior.  For  ths  1965-74  Cohort  Croup,  croas-val idated  R*  values 
ranged  from  .135  to  .331,  with  a  median  R*  of  .177.  For  the  1976-60  Cohort 
Group,  the  R*  valuee  ranged  from  .122  to  .723,  with  a  median  R*  of  .259. 

These  cross-validated  coefficients  show  some  drop  from  ths  original  values  but 
e  eubetantial  amount  of  ’true  verianca*  captured  by  the  origina!  models,  as 
wel  I . 


Cone lus Ion 

The  Combined  Anelyees  damonatrate  that  wa  can  predict  substantial 
variance  In  retention  behavior  from  a  precommiaaionlng  parapective.  !<ora 
Important,  the  Air  Force  can  uet  thaaa  variables  to  enhance  currant  select icn 
procedures  by  salacting  officsr  candidates  with  a  view  to  thair  likslihood  of 
retention.  This  could  be  secumpi Ished  by  including  e  'Retantion  Index'  in 
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•ach  applicant’s  sslaction  paokaga.  HotiMvar,  this  incraaaad  prediction/ 
aaiaction  pomr  cannot  ba  obtained  without  substant iai iy  anhancing  our  current 
applicant  information.  ATC'a  Contnissioninn  Programs  Directorate  is  now 
examining  both  the  utility  and  policy  implications  of  thie  approach. 
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Can  an  Expert  Systea  Assist  Air  Force  Managers  With  This  Task? 
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Arizona  State  University  -  West  Campus 

Abstract 

This  manuscript  examines  the  possible  application  of  expert 
systems  technology  tc  the  managerial  task  of  performance  feedback. 
Proponents  of  expert  systems  argiie  chat  these  knowledge  rich  systems 
can  provide  managers  with  assistaivce  in  accomplishing  tasks  such  as 
performance  feedback.  In  this  manuscript,  one  such  expert  system, 
Performance  Mentor,  is  described.  In  addition,  empirical  findings  are 
presented  \xsing  this  expert  system  and  Air  Force  managers. 

In  May  1987 ,  the  senior  leadership  of  the  Air  Force  embarked  on  a  review 
of  the  officer  corps'  performance  appraisal  system  (Dalton,  May  18,  1987).  In 
early  1988,  a  similar  review  of  the  enlisted  performance  appraisal  system  was 
launched  <AFP  39-15,  May  1,  1989).  Today,  the  Air  Force  has  two  new 
performance  appraisal  systems,  the  Officer  Evaluation  System  (OES)  and  che 
Enlisted  Evaluation  System  (EES) .  The  heart  of  both  appraisal  systems  is  the 
perfomumce  feedback  session  conducted  by  the  immediate  supervisor.  These 
feedback  sessions  involve  the  supervisor  sitting  do%m  with  the  employee  for 
the  sole  purpose  of  providing  work-related  performance  information. 

Performance  Feedback  Process 

Providing  performance  feedback  to  employees  is  considered  one  of  the  most 
important  activities  within  an  organization  (Stoner  d  Wankel,  1986),  and  yet 
one  of  the  most  difficult  for  managers  to  perform  (Ivancevich,  Donnelly,  & 
Gibson,  1986).  Larson  (1984)  argues  that  feedback  about  an  individual's 
performance  is  an  ’ntegral  component  of  any  organizational  control  system. 
Without  it,  change  in  performance  only  occurs  by  accident.  Unfortunately, 
supervisors  seem  to  resist  giving  performance  feedback,  particularly  if  the 
feedback  is  negative  in  nature  (Fisher,  1979).  However,  Hawkins,  Penley.  and 
Peterson  (1981)  found  chat  employees'  performance  racings  were  higher  for 
those  employees  who  reported  receiving  high  levels  of  performance 
communication  from  their  supervisors.  Thus,  it  is  imperative  that 
organizations  like  the  Air  Force  ensure  that  managers  not  only  provide 
performance  feedback,  but  that  those  managers  do  it  well. 

Managers  find  it  difficult  to  provide  performance  feedback  to  their 
subordinates  for  two  primary  reasons.  The  first  is  that  managers  realize  they 
do  not  possess  the  necessary  skills  (knowledge,  cognitions,  and  behaviors)  to 
effectively  perform  the  task  of  giving  negative  feedback  (Carroll.  1982; 
Lefton,  1985).  Because  they  do  not  possess  these  skills,  managers  realize 
that  performing  tills  task  ineffectively  could  damage  or  destroy  the 
interpersonal  relationships  they  have  developed  with  their  subordinates. 
Second,  having  come  to  this  conclusion  about  their  skill  deficiencies, 
managers  develop  low  self-efficacy  expectations  (Bandura,  1977;  Bandura  & 


Schunk,  1981)  about;  cheir  ability  to  successfully  provide  negative  feedback 
while  maintaining  a  positive  interpersonal  relationship  with  that  subordinate. 

Since  Kaier  (1958)  wrote  that  the  reason  for  the  failure  to  provide 
performance  feedback  was  attributable  to  a  lack  of  managerial  skill, 
organizational  practitioners  arid  Eianagement  scholars  alike  have  attempted 
three  different  ways  to  provide  inexperienced  managers  with  the  necessary 
loiowledge  base  to  effectively  conduct  feedback  sessions.  These  methods 
(social  learning,  training,  and  education)  have  not  been  particularly 
successful . 

A  potential  solution  to  this  problem  could  be  the  use  of  expert  systems. 
Expert  systems  that  claim  to  prov'ide  managers  with  the  necessary  knowledge  and 
skills  to  perform  such  managerial  functions  as  planning,  organizing, 
directing,  and  controlling  are  currently  being  developed  (Silverman,  1987). 
More  recently,  expert  systems  that  claim  to  provide  managers  with  the 
necessary  knowledge  and  skills  to  perform  managerial  tasks  such  as  providing 
performance  feedback  have  appeared  (Blanning,  1987;  Kearslcy,  1987).  One  of 
those.  Performance  Mentor,  seems  particularly  useful  to  Air  Force  managers. 

Performance  Mentor 

Performance  Mentor  is  a  commercially  available  rule -based  expert  system 
with  over  350  rules.  According  to  the  developers,  the  advice  provided  by  the 
system  is  based  on  a  massive  literature  search  by  the  knowledge  engineer  and 
utilizes  material  from  over  100  sources  (Schlitz,  1986).  Performance  Mentor 
is  designed  to  assist  the  manager  in  the  feedback  process,  not  in  the 
evaluation.  The  first  step  for  a  view  user  of  Performance  Mentor  is  to  profile 
himself/herself  and  the  organization.  The  managerial  profile  is  done  by 
selecting  descriptive  terms  (e.g.  relaxed,  charming,  precise,  cautious)  from 
59  different  terns  offered  by  the  software.  Similarly,  the  manager  selects 
from  45  terms  (e.g  isolated,  pragmatic,  free,  friendly)  to  profile  the 
workplace.  To  coiSpiete  the  workplace  profile  and  managerial  style  profile,  38 
multiple  choice  questions  are  asked.  They  deal  with  such  things  as  the  user's 
experience  giving  performance  appraisals.  This  information  is  stored  by  the 
system  in  a  separate  database  so  that  it  can  be  updated  when  changes  occur. 

Next,  the  software  asks  the  manager  to  profile  each  of  his/her 
subordinates.  Using  68  terras  similar  to  those  used  for  the  manager,  each 
subordinate  would  be  described.  After  completing  these  profiles,  the  manager 
can  obtain  advice  from  Performance  Mentor.  During  an  advisory  session,  the 
system  asks  a  series  of  66  multiple  choice  questions.  These  deal  with  such 
matters  as  Che  particular  person's  experience  on  the  job  and  his/her  responses 
to  previous  performance  feedback  sessions.  Performance  Menror  also  asks  the 
manager  tc  describe  the  immediate  work  setting  and  the  of  feedback  which 

will  be  provided  to  the  subordinate.  The  system  then  uses  all  of  this 
information  to  recommend  a  performance  feedback  interviewing  strategy'  for  each 
superior-subordinate  dyad.  These  reports  typically  run  two  to  four  pages. 
While  reviewing  the  advice  on  the  screen,  it  is  possible  to  get  explanations 
as  to  why  chat  advice  is  being  given.  Those  explanations  frequently  serv't  to 
teach  the  user  the  "why"  behind  recommendations. 

Performance  Mentor  cakes  a  broad  approach  to  performance  feedback.  It 
incorporates  empirical  findings  from  the  feedback  literature  as  well  as  from 
the  literature  about  human  relations,  interpersonal  conmunications ,  and 
personality.  For  these  reasons.  Performance  Mentor  seems  to  provide  a 
complete  and  realistic  recommendstion  on  how  to  conduct  performance  feedback 
interviews . 
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While  the  claims  of  proponents  of  expert  systems  sutn  as  Performance 
Mentor  seem  premising,  those  claims  have  not  been  supported  by  carefully 
collected,  objective  research  data  as  opposed  to  more  subjective,  anecdotal 
reports  from  users.  As  Dr.  Arie  Lewin  (1936)  said  at  the  3.986  Annual  Academy 
of  Management  Conference,  "VTliether  these  new  systems  help  managers  is  still  a 
questioi^  to  be  auiswerecl.  Ue  just  don't  know.  At  present,  we  are  working  on 
faith. " 


Empirical  Finding 

Petarson  (1988)  designed  an  experiment  to  test  this  question  using 
Performance  Mentor.  The  subjects  (N-SC)  were,  ail  Air  Force  managers.  Half  of 
the  managers  used  the  sxpert  system  trhilc  the  other  half  did  not.  The 
subjects  performed  the  rolt  of  a  supervisor  of  three  purchasing  agents.  The 
setting  was  a  highly  realistic  task  involving  extensive  paper  documentation  of 
parforaanev  as  well  as  a  lb  minute  long  videotape  of  the  individual  to  be 
evaluated  showing  him  at  work. 

The  important  poinr  was  not  the  actual  performance  appraisal  evaluation 
(which  was  designed  to  be  negative),  but  the  feedback  session.  In  this  study, 
the  focus  was  on  the  managers  ability  to  identify  the  appropriate  behavior.'^ 
for  a  negative  performance  feedback  session.  The  subjects  had  to  specify  what 
they  felt  where  the  ten  correct  behaviors  from  a  list  of  50  possible 
behavioral  responses  which  included  both  correct  things  to  do  such  as 
'acknowledge  his  experience  and  tell  him  you  know  he  can  do  the  job  if  he 
wants  to”  and  incorrect  things  to  do  such  as  "demand  an  explanation  for  his 
sloppy  ordering  over  the  last  six  months."  In  addition,  the  list  of  possible 
behavioral  responses  also  included  some  neutral  behavioral  responses  such  as 
"call  the  individual  in  immediately."  These  responses  are  not  intended  for 
sharing  information  cr  feelings;  they  are  used  only  to  open  the  lines  of 
communication  for  more  meaningful  communication  later  on  (Verderber,  1981), 

The  results  clearly  support  the  hypothesis  that  an  expert  system.s  can 
really  help  Air  Force  managers  do  their  jobs  better.  Managers  using  the 
expert  system  performed  400  percent  better  on  tbie  task  of  identifying  correct 
behavioral  responses  than  the  managers  not  using  the  expert  system.  Farther 
support  for  the  hypothesis  can  be  gleaned  by  examining  the  number  of  incorrrtC 
behaviors  chosen  by  the  two  groups.  Managers  using  the  expert  system 
Identified  fewer  of  the  incorrect  behaviors  as  being  appropriate  than  did  the 
managers  not  using  the  system  (6X  versus  17X) .  These  findings  are 
significantly  different  at  the  .05  level  using  the  student's  t-test  statistic, 
yhether  these  managers  would  foliov  through  on  their  intentions  and 
effectively  apply  that  knowledge  is  another  issuj .  But,  these  results  suggest 
that  the  potential  is  there  since  the  expert  system  did  aid  the  mangers  in 
identifying  both  the  proper  behavioral  responses  and  the  improper  behavioral 
responses . 

One  aspect  which  was  not  directly  tested  or  analyzed,  but  which  was 
observad,  was  that  the  use  of  the  expert  system,  while  substantially  improving 
the  quality  of  the  process,  seemed  to  slow  down  the  decision  process.  On  the 
average,  ic  took  managers  using  the  expert  system  15  minutes  more  to  come  to  a 
decision  than,  it  did  the  managers  not  using  the  expert  system.  From  a 
coat/benefit  perspective,  the  use  of  the  expert  system  still  appeared 
worthwhile  considering  the  increase  in  appropriate  behavioral  responses 
achieved  over  this  period  of  time.  This  type  cf  infomation  will  be  essential 
a.s  one  evaluates  tiie  costs  and  benefits  of  the  application  of  expert  systems 
to  managerial  tasks. 
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Implications 


The  results  above  suggest  a  number  of  important  implications  for  managers 
and  the  Air  Force.  First,  while  managers  are  not  generally  trained  in 
providing  performance  feedback,  the  training  involved  in  this  study  was 
extremely  brief,  and  yet  it  yielded  good  results.  If  similar  brief  training 
sessions  yield  similar  results  with  other  expert  systems,  then,  training  time 
and  training  costs  can  be  reduced  using  expert  systems.  This  would  mean  that 
new  Air  Force  managers  could  more  rapidly  reach  the  levels  of  effectiveness  of 
experienced  managers . 

Another  implication  is  that  the  use  of  an  expert  system  will  slow  the 
decision  making  process,  but  will  provide  a  bettor  solution  to  the  specific 
performance  feedback  situation.  While  most  computer  tec'nnology  is  billed  as 
providing  information  faster,  expert  systems  may  actually  slow  the  process. 
In  this  study,  the  expert  system  slowed  the  manager's  decision-making  by  about 
fifteen  minutes,  but  increased  their  performance  feedback  knowledge  fourfold. 
This  slowing  of  the  decision  process  seems  to  be  beneficial  in  that  it  allows 
more  alternatives  to  be  examined  than  would  be  examined  without  tlie  system. 
This  certainly  seems  like  a  reasonable  tradeoff  given  the  importance  of 
providing  performance  feedback  to  subordinates  and  the  difficulty  that 
managers  have  with  this  managerial  task. 

A  final  implication  for  organizations  is  that  if  expert  systems  can 
provide  expert  advice  on  one  managerial  task,  they  may  be  able  to  provide 
advice  on  many  of  the  other  managerial  tasks  that  face  managers.  The  results 
of  this  study  show  that  expert  systems  can  do  these  things  quite  impressively. 
The  challertge  of  the  future  for  organizations  will  be  extracting  and 
organising  the  knowledge  they  have  regarding  the  various  managerial  tasks  to 
be  used  in  building  expert  systems.  The  knowledge  and  technology  to  do  this 
are  now  available. 


Conclusions 

Clearly,  then,  managers  and  organizations  may  benefit  from  the  use  of 
expert  systems  even  for  areas  of  administration  which  are  not  routine  and 
quantifiable.  Furthermore,  the  authors  believe  that  this  study  and  future 
research  into  managerial  expert  systems  will  provide  management  scholars  and 
practicing  managers  with  the  knowledge  and  skills  necessary  to  perform  complex 
managerial  tasks  such  as  providing  performance  feedback  in  a  confident, 
professional,  and  humane  manner.  By  so  doing,  organizations  will  experience 
an  increase  in  human  productivity  which  is  uitiiaately  what  organizations  pay 
managers  to  achieve . 
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Abstract 


Titis  artide  eiamines  the  csreer  decision  factors  of  Air  Force 
female  aviators.  The  major  dedsinn  facUH^  differ  depending  on  the 
died  career  intention.  Fa&i^/  ooiH»ms,  due  in  large  part  to  the 
current  joint  spouse  policy,  are  primtry  decisuHi  factor  for  all 
female  aviators,  job  satisfactitm  concerns  are  minor  in  comparison 
to  ofyerail  career  ocmoems.  Female  aviators  cite  limited  command 
i^porlunity  and  the  effects  of  current  combat  exclusion  lavs  and 
policies  as  major  career  decbion  factors.  The  current  policies 
regarding  combat  exclusion  and  joint  spouse  are  seen  as  structural 
barriers  to  career  advancement. 


After  a  “roling  by  the  Can;<idian  Human  Eights  Tribunal  that  combat  exdusiori 
vas  discriminatory,"  the  ensuing  integration  of  vomen  into  combat  roles  in  Um 
Canadian  forces  b^an  in  March  of  1989  (Bird,  1989,  p.  16).  The  events  in  Canada 
and  the  mcx’e  recent  United  States  invasion  oT  Panama  have  resurfaced  the 
debate  over  the  validity  of  current  United  States  lavs  and  policies  excluding 
vomen  from  combat  rdes. 


A  d^iue  aired  on  F»oe  the  NMtaoa  barely  a  week  rfter  the  United  States 
began  vithdraval  of  troops  from  Panama  (St^  1990).  Representative  Pat 
Schroeoer,  vho  favors  alioving  vomen  in  combat,  debated  the  validity  of  reasons 
cited  by  Brian  Mitchell,  author  of  The  Weak  Ltnlc  for  keeping  vomen  out  of 
combat  roles.  Cos^essvoman  Schroeiter  recommended  a  four-year  trial  of 
integrating  vomen  into  combat  rdes,  similar  to  the  trial  that  preceded  the  full 
role  integration  of  vomen  into  the  Canadian  forces. 

CurrenUy,  the  Air  Force  continues  to  redefine  combat  aircraft  and  misskms. 


These  efforts  have  resulted  in  opening  98  percent  of  all  career  fields  and  96 


pcfCcui  ci  ill  positkw  ic  vcmcn  isird,  usfcrtuaxtciy  the  d  percent  cf  the 
restricted  positions  include  some  of  the  most  coveted  jobs  in  the  service, 
includuig  flying  bomber  and  fighter  aircraft.  Those  positions,  in  fighters  and 
bombers,  are  also  part  of  Ute  traditional  path  to  key  command  positiocii  and 


/xtL_.4  inoa^ 


iV"  fW* 


162 


high-'^el  prcmoticms. 

Pkvukis  redetrcfa  into  the  oombet  ezdusion  issue  focused  upon  the  opinion 
of  feagifde  ptk)te  in  the  United  Stetes  Air  Force  (USAF)  as  to  vi^ther  they  feft  they 
could  perfcrm  the  combat  misskm  (Petereon,  !98S).  The  condusms  of  this  study 
shoved  that  USAF  vomen  pilots  not  only  felt  that  tStey  had  the  abMiiy  to  fly 
combat  misskms,  but  that  not  being  alloa’ed  to  fly  combat  vrcraft  hiodered  their 
career  and  halted  upward  prcgresshm. 

Further  re^sarch  into  military  women's  pefttptions  (e^.,  integration,  issues 
and  the  opportunity  for  advancement)  was  conduded  in  a  Govcmasent  SiKCUiJve 
survey  which  focused  on  the  opinions  of  senior  vozoen  lic^  officers  (0*  5, 0-6  and 
0-7)  within  the  Department  of  Defense  (Si^rvood,  1989).  The  results  of  this 
survey  indicated  that  women  feel  that  they  me  not  advancing  fast  enough  in 
their  miUtary  careers,  and  they  cited  structural  barriers  (presented  by  the 
combat  ezduticn  laws  and  policies)  and  cuttyral  barriers  (e.g..  sexual  harassment 
and  inter&cthm  with  superiors). 

Previous  research  suggests  that  women  face  both  cultural  and  structural 
barriers  as  they  progress  in  the  militar/.  In  light  of  recent  events  regarding 
women  in  oontoai.  Uu3  study  solicits  the  pcrceplioos  of  those  women  most 
idfected  by  these  barriers-  Air  Force  female  aviators.  Vhal  do  these  women 
oonsidar  es  factors  affecting  their  future  career  dedsioius? 

Method 

Tne  difscriptive  data  reported  here  are  a  smail  part  of  a  target  study  of 
female  AL'  Force  aviators  who  are  meBd)ers  of  Women  MiiiLan^  Aviatore,  Inc. 
iWHk).  The  survey  respondents.  pikKs  and  navigaiers,  oompbted  a  1 40-item 
questionnaire  that  included  var^s  demography  questions  and  both  cultural  and 
mructurai  aUitudinai  quesUoss.  The  questionnaire,  sent  out  in  early  November, 
drew  responses  from  120  active  duty  Air  Force  femaie  aviators  (a  53  pet  cent 
return  rate).  These  oCtkers  represent  apprcximately  22  percent  of  the  total 
popuhUioo  of  Air  Force  female  aviators.  An  ideal  study  would  indude  all  Air 
Fdroe  female  aviators,  but  time  and  cost  cmistraints  ^hibited  a  aert 
cctmprebenai'^  survey.  However,  tbet  e  is  no  reason  to  beUeve  that  thii  sample 
does  net  adequately  represent  the  views  of  ail  Air  Force  female  aviators. 
Ijtmcsrsphisaily,  ihe  survey  respondents  are  diverse  in  ter  si;  of  ige,  of 

service,  military  rank,  and  major  command  affiliailxL 


Results 


Table  1  (»resefits  a  comparisoc  of  fei&ale  aviators  who  Indicated  their  future 
cafMT  intentions  (Le..  reoiain,  separate,  or  undecided}.  These  three  samples  of 
women  aviators  were  analyzed  by  career  decision  factors  lie.,  family,  job,  career, 
and  other). 


Table  1 

CAREER  I^ISK^  f  ACTOR 


N 

Family 

job 

Career 

Other* 

Re  main  in  AF 

36 

-11.7% 

13.9% 

333% 

11.1% 

CAREER 

Separate 

36 

58.3% 

11.1% 

25.0% 

5.6% 

INTENTION 

Undecided 

37 

45.9% 

24.3% 

163% 

13.5% 

*C»ateal«aalyittef  writtao  aiseiaantt  oo  diaiact  pattern  of  coacoms 


Regat  dieis  of  career  intentions,  family  ocnoems  are  most  often  dted  as  a 
factor  for  future  career  dedtioos.  When  asked  to  rate  their  number  one  family 
onooem,  psroent  of  the  respondents  indicated  that  the  joint  spouse  assignmmit 
policy  was  a  major  dissatisfaction  However,  family  concerns  are  lessened  for 
those  women  who  plan  to  remain  in  the  Air  Force. 

The  second  greatest  ooooem  was  reported  to  be  career  factors  which 
liicre&sc  for  iho:&  who  plan  to  make  the  Air  Faroe  a  career.  Thirty-sii  percent  of 
the  women’s  an^sier  oonoems  centered  around  itructural  barriers  imposed  by 
Cufoba.  esd'iskm  laws  (ie..  promotiofi  opportunity,  limited  command  ^pcrtunity 
and  combat  rerj*i::!iQn8).  While  not  a  miqarity.  the  remaining  oonoems  were 


«uv<w4 


Tha  third  factor  dealt  with  job  coooems  (e.g.,  lack  of  responsibility  and  extra 
military  duties  beyond  flying).  Although  this  category  was  rated  relatively  Kyw  in 


$Qijai0int^  to  tbe  oUmts.  50  pcareest  of  those  surveyed  listed  tssisomefit  kxailioc 

ocmoeni.  For  thcae  ufidectded,  there  is  s  shift  from  family 
|j^d  carets  dohoenm  to  ooDoerh  aiM)ut  job  sat^ 


nbcussion 

Tbe  result  of  the  study  seem  to  indic&te  a  relationship  betveca  career 
htteotiQat  and  career  decttiofi  factors.  Regardless  of  indicated  career  itdentiao, 
family  cxmeems  play  a  mtlor  role  is  career  dedskm  for  Air  Force  female  aviators. 
ApprcoiAitely  one-third  plan  to  separate  from  the  Air  Faroe,  citing  family 
oonoems  as  tbe  reason.  The  remaining  tvo-thirds  of  the  vomen  (Le..  undecided 
and  pl8D  to  stay)  also  report  that  the  current  }oisl  spouse  policy  is  a  major  factor 
in  the^  fuiure  career  deoeon. 

These  vnmen  who  ire  still  undecided  about  theif  crneer  die  family  concerns 
asa  primary  career  dmauon factor;  hofvevef.  they  also  are  oonoefned  with  job 
satiiftctAnn.  they  are  undecided  about  their  future  career,  their  focus  is  on 
daiy^  job  satisuction-  is  this  a  job  upon  vhtch  to  develop  a  career? 

Fm  imaen  vbo  plan  to  stake  the  Air  Force  a  career,  fajnily  concerns  are  stiil 
paramount  These  vomes  have  aooepted  tome  type  of  balance,  ranging  from 
oofflplete  aaorffice  of  famiitai  rales  to  an  assuasptioa  of  multiple  roles  as  vorker, 
vife.  and  mother.  Nov,  an  htcreased  factor  beoosws  cvew  oonoems.  They  like 
their  Jobs,  hut  are  oonoemed  about  career  progresskm,  specifically  related  to  the 
issue  of  combat  roles.  Bgluy-five  percent  cited  limited  command  opportunites 
and  oombm  esdutaon  lavs  u  deterrents  to  ctfeer  progression.  In  oompariaon  to 
the  Govenuaeat SxaoiUw  survey  (in  vhich  35  paroem  of  senior  female  cfficers 
reported  that  vomen  are  not  advasctng  fast  enoc^hX  73  peroent  of  the  surveyed 
feaiale  avtators  feel  arcMien  are  not  advaadag  fast  enough.  Iheir  more  negative 
disparity  in  opinicn  any  reflect  hov  they  are  affected  daily  by  the  current 
ooi^at  dctusion  lavs  and  potties—  they  canT  fly  fighter  aircraft  vhkh  often 
lead  to  key  coeuaand  poaitioos. 


Coodtision 

Today,  with  the  retentkn  probleau  among  aviatiors.  Air  Forc^  leaders  must 
seek  solutioQS  to  retain  flyers.  To  retain  female  aviators,  structurai  barriers  must 
be  eliminated.  Present  combat  eiduskm  lavs  ami  poiic^^  are  career 
dednon  factors.  These  lavs  and  pdides  need  to  be  readnded  m  iS'der  io  reta^ 


ilfta  prhttirily  $ 

^^t>oM^ODQoemfor  msttimi  li»  qo£  geader 

for  ^  Gurrsat  faiot  tpoosG  poiky  to  htvo  a  ni^atcy^  betrtog  upon 
csreef  derfiiOQs  of  aviators  eta  o&tjr  add  to  tao  current  manpover  crisis.  It  is 
timo  to  ijiiipiemeiit  polkas  to  retain  our  ii^y  if aised  avktors,  both  cu^n  and 
vomen. 
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Abstract 

Recent  research  (Eisenberger,  Himtington,  Hutchinscsi,  &  Sowa, 
1936;  Kottke  &  Stiaraf inski ,  1933)  suggests  that  the  inhlvihual's 
perception  of  organizational  support  forms  a  significant  component 
of  the  individual's  coaunitaent  to  the  organization.  Following 
recent  developments  in  affect  research,  the  present  study  examined 
the  interacticKi  between  dispositional  positive  affect  and 
organizational  support  in  the  prediction  of  organizational 
comaitgffint.  Data  collected  from  personnel  working  in  a  Department 
of  Defense  training  facility  indicated  that  positive  affect 
moderated  the  relationship  between  perceptions  of  organizational 
support  and  organizational  commitment.  These  results  have 
implications  for  research  on  crganizational  commltaent. 


For  some  time  now,  organizational  researchers  have  studied  the  construct 
of  organizational  commitment  and  its  relationships  with  various  situational 
characteristics,  attitudes,  and  behaviors.  Commitment  is  an  issue  of 
considerable  importance  to  the  Department  of  Defense.  Indeed,  research  has 
been  based  on  the  explicit  assumptions  that  commitment  is  a  (xstential 
determinant  of  performance  (DeCotiis  &  Summers,  1987),  turnover  and 
absenteeism  (Zaccaro  &  Collins,  1938),  and  prosocial  behavior  (O’Reilly  & 
Chatman,  1936}  and  that  the  primary  antecedents  of  cocomitment  are  within 
comEu?nd's  ability  to  influence  (Angle  &  Perry,  1983). 

The  objective  of  the  present  study  was  to  further  explore  the  conceptual 
bounds  of  organizational  commitment.  .Adopting  an  interactional  psychology 
perspective,  the  introduction  draws  parallels  between  research  on 
organizational  commltaent  and  related  concepts  at  the  situation  and  person 
levels,  namely  organizational  support  and  dispositional  positive  affect. 

While  studies  of  organizational  commitment  have  examined  both  person  and 
situational  variables,  they  have  seldom  examined  the  interaction  between 
person  and  situational  antecedents  of  commitk^ent.  Proponents  of  the 
interactional  psychology  perspective  assert  that  behavior  is  a  function  of  an 
interaction  between  the  person  and  situation.  The  person  is  seen  as  an  active 
participant  in  the  interaction  process,  changing  the  situation  and  being 
changed  by  it  (Terborg,  1961),  This  perspective  promotes  explicit  assessment 
of  situational  variance  in  cues,  rewards,  or  opportunities  and  individual 
variance  in  oognltlcnS:  abilities,  or  motivation.  However,  an  important 
element  or.  the  person  side  of  the  interaction  has  been  overlooked: 
dispositional  positive  affect. 

^TiUs  paper  reflects  the  opinion  of  the  authors  only  aiid  should  not  be 
construed  as  official  policy  of  the  Department  of  Defense  or  any  organization. 


To  predict  organizational  commitment,  we  examined  situational  variance  in 
rewards  and  opportunities  operationalized  as  the  individual’s  perceptions  of 
support  given  by  the  organization.  Individual  variance  in  affect  was  assessed 
in  terms  of  the  individual’s  dispositional  positive  affect. 

A  considerable  literature  has  examined  the  situational  antecedents  of 
commitment.  Recent  research  CElsenberger,  Huntington,  Hutchinscaa,  &  sowa, 
19d6;  Kottke  &  Sharaf inski,  1988)  suggests  that  the  individual's  perceptions 
of  organ! zationaLi  support  have  a  significant  bearing  on  commitment  to  the 
organization.  Bisenberger  et  al.  (1986)  argued  t'*"'*’  individuals  who 
consistently  receive  formal  support  from  the  organization  (e.g.,  provision  of 
necessary  equipment  arid  time  to  get  work  done,  organization  leaders  "standing 
up"  for  individuals  under  fire)  and  informal  support  from  their  colleagues 
(e.g.,  assistance  with  a  heavy  work  load,  emotional  help  in  times  of  stress) 
are  more  likely  to  be  coaiaitted  to  the  organization. 

Attempts  to  identify  person-level  influences  of  commitment  have  focused 
on  such  factors  as  demographic  variables,  attributional  tendencies,  and 
stress.  We  suggest  that  an  individual  component  of  commitEent  to  the 
organization  is  the  individual's  dispositional  positive  affect. 

Recent  davelopaents  in  affect  theory  and  measurement  indicate  that 
positive  and  negative  affect  are  independent  dimensions  of  disposition  (Diener 
i  Emmons,  1935).  Positive  affect  has  been  defined  as  "reflecting  the  extent 
to  which  a  person  feels  enthusiastic,  active,  and  alert"  (Watson,  Clark,  & 
Tellegen,  1986,  p.  1063).  Indiviauals  high  in  positive  affect  tend  to 
experience  high  energy,  full  concentration,  and  pleasurable  engagement, 
idiereas  individuals  low  in  positive  affect  tend  to  experience  lethargy  and 
sadness. 

In  line  with  the  definition  of  positive  affect,  we  hypothesized  that 
positive  affect  scores  would  be  positively  correlated  with  perceptions  of 
organizational  support  and  commitment.  Individuals  who  are  cispositionally 
more  enthusiastic  and  energet.ic  may  be  more  likely  to  perceive  greater  support 
from  the  organization  and  manifest  ccxnmltment  to  it. 

In  line  with  the  interactional  psychology  perspective,  we  expected 
perceptions  of  3upp>ort  to  differentially  account  for  variance  in 
organizational  commitment  among  individuals  with  different  levels  of 
dispositional  positive  affect. 

Since  individuals  low  in  positive  affect  tend  to  be  sadder  and  more 
lethargic,  it  is  likely  that  they  would  look  more  to  the  work  environment  in 
the  development  of  their  commitment;  because  individuals  high  in  positive 
affect  tend  to  be  dispositionally  enthusiastic,  the  work  environment  would  be 
less  salient  in  the  development  of  their  commitment.  Thus,  perceptions  of 
organizational  support  should  be  more  highly  correlated  with  organizational 
commitment  among  individuals  low  in  positive  affect  than  among  individuals 
high  in  po.9itlve  affect. 

Method 

Forty-nine  (56J)  of  the  83  available  personnel  worKing  in  a  DoD  training 
facility  in  the  eastern  U.S.  voluntai'ily  and  anonymously  completed  an 


"or^aoiaatioaal  survey  including  the  Eisenberger  et  al.  (1986)  measure  of 
perceived  organ izati anal  support  (T  =  iJ7.17,  ^  =  6.9.  alpha  =  .9^),  the 
irfatsoc,  Clark,  &  Teiiegen  (1966)  positive  affect  scale  (Y  =  35.37;  ^  =  7.^; 
alpha  .97),  ana  the  Hrebiniak  and  Alutto  (1972)  measure  of  organizational 
cosMlitaient  (T  =  12.07;  SO  =  alpha  =  -79).  .High  scores  <xi  the  support 

scale  indicate  perceptioriS  of  greater  support.  High  scores  on  the  positive 
affect  scale  indicate  higher  positi/e  affect.  High  scores  0.1  the  commitment 
scale  Indicate  greater  commitment  to  the  organization.  Directions  for  the 
positive  affect  scale  instruct  Individuals  to  indicate  how  they  generally  feel 
by  respoadirig  on  a  5-point  scale  (1  x:  very  slightly  or  not  at  all;  5  = 
eatremeiy)  to  10  adjectives  (e.g.,  enthusiastic);  this  scale  assesses  how 
individuals  feel  generally  (i.e.,  trait  or  dispositional  positive  affect) 
rather  than  state  positive  affect  (Matson  &  Clark,  196'^). 

Results  and  Discussion 

Positive  affect  scores  were  positively  related  to  both  support  (£  =  .50, 

£  <  .01)  and  commitment  scores  (£  =  .52,  jp  <  .01).  Support  and  commitment 
scores  were  positively  related  (£  =  -83,  £  <  .01). 

Moderated  multiple  regression  was  used  to  assess  the  moderating  effect  of 
positive  affect  by  adding  the  cross-product  term  as  a  separate  predictor  in 
the  equation  (Zedeck,  1971).  The  commitment  scale  scores  were  regressed  on 
positive  affect  scale  scores,  support  scale  scores,  and  their  cross-product 
term.  Kisrarohical  multiple  regression  was  then  used  with  the  positive  affect 
scores  and  support  scorjs  entered  first  and  their  cross-product  term  entered 
second.  The  significance  of  the  incremental  (A  with  the  Edition  of 
the  cross-product  term  was  assessed.  The  addTtion  of  the  cross-product  term 
added  significant  variance  to  the  prediction  of  commitment  (full  model 
adjusted  3  .368410:  reduced  model  adjusted  £2  _  A  =  .01784, 

F  =  24.95,  p  <  .01).  “ 

In  oraer  to  assess  the  direction  of  the  interaction  and  to  test  the 
hypothesis  that  the  sup port -commitment  relationship  would  be  greater  among 
inaividuals  low  in  positive  affect  than  those  high  in  positive  affect,  the 
subgrouping  method  of  examining  differential  correlations  was  employed  (cf. 
Arnoia,  1982).  Scores  on  the  positive  affect  scale  were  split  on  tne  median, 
creating  groups  low  emd  high  in  positive  affect.  Zero-order  correlations 
between  the  scores  00  the  organizational  support  scale  and  organizational 
coflunitment  scales  were  then  computed  for  both  the  low  and  high  groups. 
Confirming  the  hypotheais,  the  results  indicated  that  support  was  more  highly 
related  to  commitment  among  individuals  low  in  positive  affect  (£  =  -83, 

£  <  .01)  than  among  individuals  high  in  positive  affect  (£  =  .21,  ns). 

Because  this  procedure  is  subject  to  a  number  of  problems,  this  was  not  the 
primary  method  used  to  assess  the  Interaction.  However,  it  permitted 
assessment  of  the  comparative  strength  of  the  correlations  between  the  low  and 
high  positive  affect  groups. 

Discussion 

Congruent  with  the  hypotneses  and  the  interactional  paycnology 
perspective,  the  results  suggest  that  perceptions  of  support  differentially 
account  for  variance  in  organizational  commitment  among  individuals  with 
different  levels  of  dispositional  positive  affect. 


Llai tat ions  of  tne  study 


Several  limitations  of  the  present  study  should  he  noted  before 
iaplieationa  are  discussed.  First,  oata  were  collected  from  a  saall  sample  of 
perscruael  working  in  a  DoD  training  organization,  which  itay  not  be 
representative  of  most  DoD  organi2:ations. 

Second,  a  number  of  variables  that  may  have  aoccuntsd  for  the  findings 
reported  here  or  additional  variance  ware  not  sssessed.  These  include 
personnel  aultipie  commitments,  personnel  rank,  conflict  between  family  and 
job  roles,  and  other  person-level  issues. 

Third,  because  it  may  also  be  suggested  that  individuals  who  experience 
certain  levels  of  support  and  commitment  may  report  certain  dispositions,  it 
is  possible  that  support  may  be  the  moderator  of  the  positive  affect- 
cotDffiitment  relationship  rather  than  the  other  way  around. 

Fourth,  because  of  organizational  consioerations ,  most  of  the 
participants  completing  the  questionnaires  did  so  in  one  sitting.  Thus,  tnese 
data  may  be  subject  to  common  method  variance.  Indeed,  in  indicating  the 
moderating  effect  of  dispositional  positive  affect  on  the  support-ccaaitment 
relationship,  the  data  provide  some  support  for  concerns  about  method  variance 
(i.e.,  by  demonstrating  the  effect  of  disposition  cn  the  relationship  between 
perceptions  of  the  work  envlrorjzent  and  oomaitcent). 

Implications  for  Management  Practice 

Efforts  to  increase  support  from  the  organization  (or  change  perceptions 
of  what  is  being  provided)  in  order  to  promote  commitment  may  be  more 
successful  among  individuals  low  in  positive  affect  than  among  individuals 
high  in  positive  affect.  Thus,  organization  development  Interventions  might 
take  into  account  individual  differences  in  dispositional  positive  affect  in 
order  to  enhance  their  effectiveness. 

Implications  for  Theory  and  Research 

The  data  reported  here  support  the  interactional  approach  to  the  study  of 
organizational  coaimitment.  Researchers  have  shown  that  eomaitment  is 
multidimensional.  The  Interactional  approach  may  be  useful  for  identifying 
antecedents  of  this  muicidioensionality.  Moreover,  additional  variance  in 
organizational  behaviors  may  be  explained  by  using  this  approach. 
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Who  says  the  Rjecniiier’s  Job  is  Stressfiii?^ 

Herbert  George  Baker,  PhD 
Navy  Personnel  Research  and  Development  Center 

Abstract 

This  paper  brings  together  evidence  from  a  variety  of  sounds  to  support  the 
contemion  that  the  job  of  the  Navy  recroitcr  is  pervaded  by  stress.  Job  stress  is 
caused  by  fectors  ranging  from  recruiter  sclccrioa  and  training,  through  iiKcmivcs 
systems,  to  organizational  policies  and  mangement  styles. 

By  dint  of  great  cfiFort,  the  Navy  recruiting  force  usually  has  been  able  to  achieve  its  goals 
relative  to  both  the  quantity  of  accessions  and  quality  of  recruits.  However,  this  has  not  been 
without  its  costs.  One  cost  has  been  a  decrement  in  recruiter  quality  of  life.  Job  stress  has  become 
a  pervasive  problem  in  Navy  recruiting,  affirciing  petsonnd  at  all  levels  of  the  cffganizatioiL  While 
stress  has  many  positive  aspects,  excessive  job  stress  or  an  inept  response  ro  it  is  iriTnical  to  quality 
of  personal  and  family  life,  individual  and  work  unit  performance,  and  (gganizarional  productivity. 

Evidence  of  Stress 


The  MEDCOM  Survey 

In  1988,  the  Naval  Medical  Command  (MEDCOM)  conducted  a  brief  informal  survey  of 
some  200  health  practitioners  eliciting  infonnation  on  both  Navy  and  Marine  Ccarps  recruiters.  The 
survey  results  provide  evidence  that  stress  and  certain  bdiaviors  which  are  often  positively 
cOTtr.laied  with  stress  are  problems  among  recruiters.  The  Navy  mwiiml  community  is  involved 
more  than  occasionally  in  personnel  evaluation  and/or  treatment 

More  than  half  (58.1%)  of  the  respondents  reported  having  “seen  a  Navy  or  Marine  Craps 
recruiter  for  stress  or  other  psychologic^  problems.*’  In  all,  309  recruiters  had  been  evaluated  for 
continuance  in  their  jobs.  Two  hundred  and  seven  recruiters  had  received  treatment  Of  those  who 
had  treated  a  recruiter,  21.9  percent  also  had  treated  a  spouse  or  other  roembcf  of  the  recruiter’s 
family.  The  most  common  diagnoses  are  listed  in  Table  1. 


Table  I.  Most  Coenroon  Diagnoses  of  Recruiters  Seen 
for  Stress  (x  Other  Psychological  Problems 


Marital  Dysfuncikui 

34.1% 

Stiess/Depie&tKm 

31.8% 

Adjustment  Disaider 

15.9% 

Alct^l  and  Drug  Abuse 

155% 

Mixed  Emotion^  Pedings 

23% 

Of  those  respondents  who  treated  a  recruiter  and/or  spouse,  14.4  percent  repenred  ha\'ing 
included  child  abuse  and  18.8  percent  reported  having  included  spouse  abuse  in  the  diagnoses. 
Furthennore,  a  number  of  abusive  or  addictive  behaviors  often  associated  \vidi  stress  were  included 
in  the  diagnoses.  These  are  reflccied  in  Table  2. 


*  Views  and  opuiions  are  those  of  the  author  a.id  do  ou  uecessarily  represent  those  of  the  Navy  or  the  DeparUTicnt  of 
Defease. 


Tabic  2.  Abusive  or  Addictive  Behaviors  Noted 


Alcohol 

38.8% 

Dreg 

12.2% 

Food 

8.8% 

Gambling 

6.6% 

The  conseasos  was:  “Apparently,  all  psychologists  agree  that  the  stress  recruiters 
face/experience  is  far  greatet/mu^  otOTe  intense  than  shipboard  environment”. 
CXJMNAVCRUTTCOM  stated  his  intention  to  pursue  stress  training  “for  all  of  Navy  Recruiting 
Command  and  titeir  spouses”. 

Naval  Inspector  General’s  (IG)  Summary'  Report  to  COMNAVCRUTTCOM 

In  1988,  the  IG  conducted  an  inspection  of  Headquarters,  CRUTTCOM,  and  “noted  with 
concent  tite  ovariding  emphasis  within  NAVCRUTTCOM  on  tMcting  goal  every  30  days  which 
(^ten  resulted  in  inadequate  command  focus  on  human  requirements  of  individual  recruiters  and 
titcir  families.”  The  IG’s  report  also  ^xtke  to:  (1)  the  burdens  borne  by  families,  many  of  which 
had  to  live  in  areas  whidi  w<nc  high  cost  and/or  remote  from  military  support  groups  and  facilities, 
and  (2)  die  high  stress  of  the  work  environment  as  contributor  to  a  qu^ty  of  life  among  Navy 
recruiters  that  was  significantiy  lower  than  that  of  “their  peers  assigned  to  other  types  of  shore 
duty.”  The  IG’s  repent  described  the  wm:k  climate  as  “jmmaiily  one  of  extreme  personal  pressure, 
long  working  hours,  and  remoteness  firom  Military  Support  Systems.”  The  IG  cited  the  following 
as  factors  negatively  affecting  the  work  environment'  (1)  constant  pressure  month  after  montit  to 
achieve  goal,  (2)  iMg  working  hours  with  leave  and  liberty  as  uncertainties,  (3)  intolerance  of 
failure  to  achieve  production  goals,  (4)  lack  of  suj^xjtt  from  supervisors,  (5)  reduction  of  tools  (i.e., 
advertising,  etc.)  from  the  Navy  to  support  “sales”  efforts,  and  (6)  reduced  resources,  occasionally 
fencing  a  cap  on  some  operating  expenses. 

No-Fault  Transfers 

Under  the  incentive  and  tracking  system  for  recruiters,  individuals  who,  through  no  fault  of 
their  own,  cannot  become  successful  (Lc.,  p’oductive)  recruiters  may  be  transfcircd  out  of 
recruiting.  This  is  called  a  “no-fault"  transfer,  which  is  not  supposed  to  exert  a  negative  career 
impacL  Typical  reasons  for  no-fault  transfers  are:  medical,  lack  of  salesmanship,  and  lack  of 
fluency  in  spoken  English.  Stress  and  stress-related  problems  are  also  valid  reasons.  As  evidenced 
by  the  No-Fault  Transfer  Log  maintained  by  NAVCRUTTCOM,  there  were  45  no-fault  transfers 
during  the  poiod  1  October  1988  through  30  June  1989.  Of  these,  many  were  for  conditions  often 
considered  stress-related;  14  of  tiiem  actually  used  the  word  “stress”  in  the  “reason  for  transfer.” 

Inmrviews  witii  Navy  Recruiters  and  Recruiting  Managers 

In  February  1989,  researcher  teams  from  the  Navy  Personnel  Research  and  Development 
Center  (NAVPERSRANDCEN)  interviewed  150  recruiters,  plus  a  number  of  supervisorial 
persom»l  in  the  ffcld  and  managerial  pcrsormel  at  several  Navy  Recruiting  District  (NRD) 
headquarters  (Robertson,  1989).  In  all,  interviev/s  were  conducted  with  recruiters  at  29  Recruiting 
Stations  and  wiib  managers  at  1 1  NRDs. 

Stress  and  pressures  of  the  job  and  their  adverse  effects  on  personal  and  family  life  were  noted 
over  and  over  again  in  the  comments  made  to  the  imerviewers.  It  was  ^parent  to  the  interviewers 
that  stress  was  endemic  among  the  Navy  recruiting  personnel,  in  some  cases  it  led  to  difficulty: 

Some  of  the  ensuing  stress-related  ailments  are  severe.  In  one  district  which 
has  usually  been  at  or  near  the  top  of  making  goals  during  recent  years, 

173 


■.<X 


I 


casualties  included  two  bean  attacks,  two  leferred  for  alcohol  lehabilitation, 
two  referred  for  being  overweight,  four  referred  fcff  counseling,  and  two  cases 
of  family  problems.  One  researcher  observed  that  several  recruiters  described 
symptoms  lesenAling  those  of  combat  fatigue  stress  diSOTdcis-drcaming 
aixiut  numbers  and  talking  ca:  yelling  in  their  sleep.  (Robertson,  1989,  p.  9) 

Relevant  conclusions  from  dtc  interviews  include:  (1)  selection  processes  permit  too  many 
individuals  who  are  not  suited  to  the  job  to  be  assigned  to  recruiting  duty,  (2)  potent  stressors 
include  extronely  long  work  hours  due  to  the  pressure  to  meet  monthly  goals  aiui  having  to  deal 
with  uncertainties,  (3)  stress  management  and  related  training  should  be  implemented  at  the 
recruiter  school  and  in  refresher  training  courses,  (4)  stress  may  also  be  caused  by  onerous 
paperweak  requirements,  and  (5)  some  job  stre^  has  its  origins  in  the  incentive  and  awards  system 
and  in  the  no-fault  transfers  that  are  incorporated  within  it 

Based  on  the  information  contained  in  the  interviews,  Robertson  (1989)  developed  a  woric 
stress  model  that  posits  a  *"chain  reaction”  whereby  intense  pressure  to  make  goal,  plus  a  number 
of  elements  outside  the  recruiter’s  control,  lead  to;  (1)  a  sense  of  failure,  (2)  stress-related  ailments, 
and  (3)  reditccd  productivity. 

The  1989  Recruiter  Survey 

A  survey  of  all  production  recruiters  (n=3,498;  3,252  responses  used  in  analyses)  was 
cotuiucted  by  NAVPERSRANDCEN  at  the  request  of  the  Recruiting  Long-Range  Plan  Study 
Group  (RL^SG),  which  bad  undertaken  to  examine  all  aspects  of  Navy  recruiting.  The 
researchers  found  additional  amfrimation  that  the  job  of  the  Navy  recruiter  is  a  stressful  one,  and 
that  a  multirude  of  potential  stressors  pervade  the  recruiting  occupational  milieu  (Baker,  Somer,  & 
Murphy,  1989). 

Tables  3  and  4  reflect  with  the  number  of  hours  worked  per  week  and  the  number  of  days 
leave  taken  in  the  past  year.  These  two  faaors  make  for  continued  and  largely  unrelieved  pressures 
on  die  job,  leaving  little  time  for  family  or  friends,  for  study  for  advancen^nt  in  rating,  or  for  taking 
care  of  personal  business.  And,  given  the  30-day  goaling  cycle,  there  is  no  letup— finish  one  month 
and  begin  immediately  on  the  next  For  the  lecruiter  who  avoids  transfer,  this  translates  into  3  years 
of  intense,  sustained  pressure;  or,  as  one  recruiter  termed  the  situation,  “Thirty-six  one-month 
tours.” 

Recruiter  responses  lo  die  survey  provide  evidence  of  potential  contributors  to  occupational 
stress  in  almost  every  area  of  the  job:  (1)  people  unsuited  for  sales  work,  or  people  with  personal 
or  family  problems  that  can  only  be  exacerbated  by  recruiting  duty  being  selected,  (2)  previews  of 
the  job  are  inadequate  resulting  in  erroneous  expectatiems,  (3)  insufficient  training  time  and 
resources  are  directed  to  stress  awareness  and  stress  management  at  the  recruiter  school  and  on  the 
job,  (4)  performance  management  systems  (supervisory  techniques,  goaling  methods,  performance 
monitoring  and  incentive  plans,  etc.)  are  being  used  that  increase  pressure  on  the  recruiter  but  do 
not  ^pcar  to  the  recruiter  to  support  his  or  her  job,  (5)  provisions  for  individual  career 
developmoit  for  recruiters  are  inadequate,  and  (6)  resources  to  support  the  wOTk  of  the  field 
recruiter  arc  loo  low. 

The  recruiter  survey  also  provided  an  opportunity  for  recruiters  to  respond  freely  about  their 
duties  and  their  quality  of  life.  A  majority  of  the  survey  respondents  (60.2%,  n  =  1 ,996)  completed 
the  frce-response  wTite-in  section.  Of  those  submitted,  1,935  (97%)  were  subjected  to  a  content 
analysis  (Aunins,  Sander,  Giannetto,  &  Wilson,  in  press). 
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Table  3.  Hours  Worked  in  a  Typical  Woic  Week 
(fion  RLRPSG.  1989) 


C18  Question:  How  many  houis  do  you  woik  in  a  typkal  woric  week? 

Frequency 

Pocem 

Gbc  Pexcem 

40  through  49 

71 

2.2 

23 

50  through  59 

384 

11.8 

14.7 

60  through  69 

1,177 

362 

5Z7 

70  through  79 

1,033 

31.8 

86.1 

80  through  89 

323 

99 

963 

90  and  VC 

107 

33 

100.0 

Nons^XHtse 

157 

43 

Total 

3J52 

loao 

70  hours  or  more  47% 
60  hours  or  more  85% 


Table  4.  Days  of  Leave  Taken  During  the  Past  Year 
(from  RLRPSG,  1989) 


C19  Questioo:  How  many  days  of  leave  did  you  during  the  past  year? 


Frequency 

Percent 

Cum  Percent 

No  leave  taken 

735 

22.6 

223 

1*5  days 

397 

122 

352 

6-lOthors 

595 

183 

53.7 

11‘IS  (bys 

648 

19.9 

733 

16-20  days 

258 

7.9 

813 

More  than  20  days 

582 

17.9 

100.0 

No  response 

37 

1.1 

Total 

3252 

99.9 

Stress  ranked  seventh  in  a  list  of  the  10  most  common  dissatisfiers.  Three  hundred  sixteen 
recruiters  made  negative  ctnnments  about  psychological  stress,  and  SO  about  physiological  stress. 
Comments  indicating  the  presence  of  family  conflict  were  marie  by  357  respondents.  Ten  recruiters 
mentioned  suicide.  Other  contributors  to  job  stress  for  the  recruiter  include:  goaling  pressures, 
excessive  wmidng  hours,  and  inept  oi  u]2re^x>nsive  supervision.  Negative  canments  about 
working  hours  ranked  n:imber  one  in  the  list  of  the  10  most  conunon  dissatisfiers,  with  global 
omnmrats  about  goals  ranklr  bird,  and  comments  about  **hammer  management’'  by  supervisors 
coming  in  fifth. 

The  proence  within  recruiting  of  so  large  a  number  of  known  stressors  compcUingly 
SubaiaiiilttLcS  iltc  kaacnioii  tiioi  icciuidug  is  a  high  sness  job.  The  responses  lo  three  items  from  the 
objective  portion  of  the  recruiter  survey  graphically  cooununicaie  this  message: 

•  Over  89  percent  agreed  with  the  statKncnt,  “My  job  as  a  recruiter  is  more  stressful  relative 
to  other  Navy  jobs.” 
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•  More  than  81  percent  agreed  with  the  statement,  ‘1  feel  much  stress  in  my  job.” 

•  Sixty-two  percent  agreed  with  the  statement,  “Jert)  stress  is  a  problem  for  me.” 

Discussion 

Qearly,  the  evidence  points  to  a  high,  perhaps  dangerously  high,  level  of  stress  extant 
throughout  NAVCRUITCOM,  and  more  than  adequate  su|^rts  the  assertion  that  stress  is  a 
pervasive  problem  for  NAVCRUITCOM.  and  that  it  is  having  some  deleterious  effects  on 
pcrfeitnance  and,  hence,  productivity.  Sufficient  medical  evidence  exists  to  point  to  the  health 
concerns;  the  number  of  no-fault  trankers  attributable  to  stress  also  ^)caks  forccMly  to  the  issue. 
Individually  perceived  stress  is  telling  in  its  overwhelming  presence  in  the  recruiter  intaviews  and 
survey.  Recniitris  feel  the  stress,  and  people  are  being  lost  due  to  str«s. 

Finally,  senior  Navy  managers  have,  through  their  own  observatioas,  reached  the  conclusion 
that  the  time  has  emne  to  put  stress  under  controL  Adding  to  me  urgmey  of  that  task  are  die  views 
of  the  House  Ap{»opriations  Committee.  In  its  report  on  the  defense  approiniatioas  bill,  the 
Committee  urged  the  services  to  relax  goal-oriented  recruiter  evaluadons  somewhat,  aiKl  in 
general,  improve  their  quality  of  life,  morale,  and  well-being.  The  Ctmunittee  sees  a  link  between 
the  stress  and  pressures  of  the  recruiter  job  and  various  forms  of  recruiter  malpractice.  With  that, 
the  Congress  has  acknowledged  recruiting  to  be  one  of  the  “most  stressful  and  difficult”  jobs  in  the 
military  (“House  Panel  Wants  Less  Stress,”  21  August  1989). 

With  evidence  in  hand,  it  was  time  to  get  underway.  CXDMNAVCRUITCOM  chose  to  address 
stress  through  a  coordinaicd  artadc  that  takes  into  account  the  mission,  the  human  and  other 
resources,  and  the  working  conditions  of  recruiting.  Under  development  is  a  comprehensive  stress 
management  program  to  be  implemented  throughout  NAVCRUITCOM  to  better  assist  recruiters 
to  accomplish  the  Navy  recruiting  mission  in  the  difficult  years  ahead. 
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Abstract 

Based  upoii  aaterial  froo  a  top-down  review  of  the  Navy  recruiting 
structure,  this  paper  represents  the  perception  of  senior- level 
recruiting  managers  as  to  the  kinds  of  research  needed  to  help  reduce 
stress  upon  Navy  recruiters. 

Military  recruiting  is  a  complex,  highly  visible  process.  Subject  to  e 
great  deal  of  critical  review  from  the  Congress  and  the  public,  reciuiting 
has  generated  a  great  deal  of  research.  HtasRRO  identified  over  1000 
studies,  conducted  over  the  last  15  years,  which  deal  with  varying  aspects 
of  military  recruiting.  The  application  of  these  studies,  anw  the  research 
coiaounities  involved,  can  be  seen  throughout  the  recruiting  process. 
Ecom»etricians,  ^rations  researchers,  and  behavioral  scientists  have  rsade 
signific«»t  contributions  toward  identifying,  iinderstanding,  and  influencing 
the  youth  market.  10  psychologists  and  psychometric ians  have  helped  generate 
major  changes  in  the  areas  of  cognitive  testing,  enlistment  standards,  and 
job  performance  measurements.  Specialists  in  manpower  modeling  have  created 
state  of  the  art  automated  systems  to  improve  the  recruiting  aspects  of  the 
time-phased  training  pipeline  flow,  and  to  create  complex  models  to  perform 
trade-off  analyses. 

There  have  also  been  a  number  of  significant  studies  done  regarding  the 
Navy  recruiter.  The  record  of  application,  however,  regarding  such  research 
has  not  been  very  successful.  It  is  ironic,  that  while  all  involved  with 
recruiting  agree  that  the  recruiter  is  the  linchpin  to  success  in 
recruiting,  the  results  of  recruiter  research  have  generally  not  been  used 
to  any  great  degree.  The  purpose  of  this  paper  is  not  to  discuss  the  reasons 
for  the  low  acceptance  of  recruiter  research.  Suffice  to  say  that,  in 
regard  to  Navy  recruiters,  there  were  a  number  of  contributing  factors. 
First,  there  was  a  perception  that  Navy  recruiters  were  an  unlimited 
resource;  they  could  be  replaced  at  any  time.  Second,  unlike  the  other 
recruiting  research,  the  application  of  many  recruiter  studies 
recommendations  would  have  to  have  been  applied  by  offices  outside  of  the 
recruiting  community;  offices  with  differing  priorities.  Third,  during  the 
1981  to  1986  period  there  did  not  appear  to  be  any  difficulties  in  achieving 
the  recruiting  mission.  The  perspective  then,  was  why  change  something 
which  seemed  to  be  working. 

The  purpose  of  this  paper  is  to  explain  the  climate  which  placed 
tremendous  pressure  upon  Navy  recruiters,  describe  events  which  resulted  In 
Navy  leadership  recognizing  the  need  for  change,  and  outline  those  elements 
of  a  research  agenda  which  could  facilitate  needed  change. 


THE  CLIMATE 

There  were  three  primary  factors  driving  the  need  to  reevaluate  the 
Navy's  recruiting  force;  An  increasingly  difficult  recruiting  environment; 


the  results  of  two  independent  studies  and  an  16  report  regarding  Navy 
recruiting;  and  Congressional  concerns. 

The  recruiting  environment.  Recruiting  difficulties  are  no  longer  only  the 
probly.'?4  of  ajilitary  recruiters.  A  continually  declining  youth  market,  whose 
popluation  shows  growing  deficiencies  in  comprehension  and  math,  and  in 
science  and  technical  skill  development,  is  creating  nation-wide  problems 
for  public  and  private  sector  recruiters.  The  Army,  and  even  the  Air  Force 
with  its  greatly  reduced  recruiting  objectives,  were  feeling  the  impact  of  a 
more  difficult  market.  Each  of  those  Services  compensated  for  these 
difficulties  by  adjusting  resources,  techniques,  and  product  offerings.  The 
Navy,  however,  remained  fairly  static  in  its  support  of  the  recruiting  force 
over  the  same  time  period.  This  resulted  in  a  less-than-competitive 
posture,  which  placed  a  great  deal  of  pressure  on  Navy  recruiters.  Navy 
recruiters  were  forced  to  achieve  mission  on  a  day-to-day  basis  as  opposed 
to  being  able  to  work  with  a  six  month  lead  time. 

Comparing  Navy  recruiting  quantitative  results  with  those  of  the  other 
Services  indicated  a  last  place  performance  in  key  areas  of  measurement. 
The  percentage  of  high  school  diploma  graduates  and  high  aptitude  youth 
entering  the  Navy  relative  to  the  other  Services  dropped  significantly.  At 
the  other  end  of  the  spectrum,  the  Navy  was  accessing  75  percent  of  the 
Category  IV  recruits  (the  lowest  acceptable  test  category  permitted  in  the 
military).  Further  a  review  of  the  numbers  showed  that  since  FY  1985,  the 
Navy  actually  had  not  recruited  even  the  numbers  of  persons  needed  to  meet 
new  contract  requirements.  The  decline  in  the  Navy's  recruiting  posture 
finally  lead  to  a  call  for  an  independent  review  of  the  Navy  recruiting 
structure  and  program. 

Independent  reviews  of  Navv  recruiting.  There  were  three  separate, 
simultaneous  reviews  of  Navy  recruitings  HutsRRO  was  connissioned  by  the 
Office  of  the  Deputy  Chief  of  Navy  Operations/  Program  Planning;  the  Deputy 
Chief  of  Naval  Operations /Manpower,  Personnel,  and  Training  commissioned  an 
independent  review  headed  by  retired  Vice  Admiral  Joseph  Metcalf  III;  the 
Navy  Inspector  General  inspected  the  Navy  Recruiting  Command.  Although  each 
group  had  differing  objectives,  their  findings  as  to  the  causes  of  the 
problem  were  quite  similar:  Senior  leadership  had  not  actively  supported 
the  recruiting  program;  there  was  no  master  strategy  nor  focused  management 
structure  to  guide  the  recruiting  program;  the  Navy  staff  was  not  equipped 
to  evaluate  or  defend  recruiting  resource  requirements,  and,  the  recruiting 
command  (CNRC)  was  unable  to  develop  programs  needed  to  understand  the  wants 
and  desi’^s  of  the  market,  and  was  unable  to  develop  the  programs  and 
incentivss  to  attract  that  market. 

CNP.C  met  its  minimal  recruiting  goals  despite  being  at  a  distinct 
competitive  disadvantage.  However,  that  performance  exacted  a  heavy  human 
toll  on  CNRC's  recruiters.  Compounding  the  stress  on  the  recruiter  created 
by  the  poor  corapetitiv'^  posture  of  the  Navy,  was  the  field  leadership 
solution  to  not  meeting  recruiting  quotas;  simply  replace  the  recruiter 
rather  than  examining  the  product,  the  training,  or  the  local  market.  Some 
districts  replaced  half  their  recruiting  force  in  a  one  year  period  of  time. 
Such  a  questionable  practice  placed  an  even  greater  burden  of  stress  on  the 
remaining  recruiters.  It  also  gained  Congressional  attention. 
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Congressional  concerns.  The  House  Appropriations  Comnittee,  in  its  FY  1990 
report,  expressed  concern  that  increasingly  constrained  market  and  economic 
climates  may  lead  to  undue  pressures  on  recruiters  to  choose  between 
maintaining  their  integrity  at  the  cost  of  their  careers  or  bending  rules 
to  make  their  goals.  The  Coaoittee  mandated  a  thorough  review  of  recruiting 
policies  and  procedures  to  assure  recruiting  objectives  can  be  achieved 
while  affording  recruiters  a  quality  of  life  comparable  to  that  experienced 
by  most  enlisted  personnel.  They  also  mandated  a  report  to  Congress,  and 
promised  hearings  on  the  subject  during  the  next  session  of  Congress. 

Identifying  Heeded  Changes 

If  the  Navy  is  to  truly  succeed  in  meeting  its  recruiting  missions, 
without  placing  tremendous  stress  upon  its  recruiting  force,  there  is  a  need 
to  better  understand  the  recruiter,  and  the  impact  of  various  elements  which 
affect  the  recruiter.  The  following  figure  presents  the  various  elements 
which  affect  recruiter  performance,  and  briefly  discusses  those  critical 
elements  where  further  research  could  help  reduce  stress  while  helping  the 
recruiter  achieve  mission. 


RecruHer  selection.  There  are  two  types  of  research  needed  in  this  ar':a: 
The  first  is  to  gain  an  increased  understanding  as  to  why  sailors  are 
extremely  reluctant  to  volunteer  for  recruiting  duty;  and  the  second  is  to 
!3(}dify  the  current  selection  pro^'esS: 


A  survey  of  sailor  perceptions.  Perhaps  the  greatest  difficulty  with 
recruiter  selection  is  that  relatively  few  sailors  are  interested  in 
recruiting  duty;  it  is  clear  that  Navy  recruiting  is  not  perceived  as  a 


career-enhancing  job.  However,  other  than  anecdotal  coranients,  there  are  no 
.real  data  which  outline  the  depth  and  breadth  of  this  problem.  There  is  a 
need  for  a  survey  to  identify  the  specific  reasons  for  such  reluctance,  and 
a  follow-on  effort  to  overcome  these  objections. 

Improve  the  recruiter  selection  process.  The  current  recruiter 
selection  process  essentially  just  screens  out  individuals  who  are  likely  to 
fail,  as  opposed  to  a  system  comprised  of  more  applicable  standards  that 
would  select-in  those  individuals  who  have  the  greatest  likelihood  of 
success.  Subsequently,  many  outstanding  sailors  selected  for  recruiting 
duty  may  not  have  the  ability  to  be  top-notch  recruiters.  Using  the 
information  obtained  in  earlier  research  as  a  base  line,  a  new  research 
effort  should  be  implemented  to  develop  a  profile  of  the  type  of  individual 
who  has  the  greatest  potential  for  success  in  recruiting.  However,  unlike 
earlier  efforts,  the  research  comrrainity  should  first  find  a  sponsor  who  will 
ensure  that  the  subsequent  Battery  be  administered  to  a  maximum  number  of 
job  candidates. 

Organizational  structure.  The  Havy  ratio  of  recruiters  to  zone  supervisors 
is  approximately  20  to  1.  By  co^arison,  the  Air  Force  ratio  is 
approximately  8  to  1,  and  the  Army  [if  you  include  the  company  commander 
(equivalent  to  the  zone  supervisor),  senior  recruiter,  and  training  NCO  as 
supervisory  personnel]  is  also  about  8  to  1.  One  question  for  the 
researcher  is,  "  With  no  additional  manpower  spaces,  how  can  the  structure 
be  modified  to  improve  the  performance  of  a  group  of  individuals,  who  have 
been  provided  only  a  modicum  of  training,  and  who  currently  receive  mininjum 
field  training  cr  supervisory  assistance'*.  From  another  perspective, 
research  is  needed  to  evaluate  the  role  of  the  zone  supervisor,  and  the 
pressures  placed  or  that  supervisor  given  the  range  of  his/her 
responsibilities  and  his/her  span  of  control. 

Vk>rk  measurement  and  procedures.  The  current  measure  of  success  in  Navy 
recruiting  is  whether  monthly  mission  was  made.  This  places  many  recruiters 
in  an  almost  untenable  position  where  they  are  under  constant  pressure.  It 
also  sacrifices  future  success  in  order  to  achieve  short  term  success.  What 
is  needed  now  is  research  from  a  bottom  up  perspective  aimed  at  developing  a 
cr iter ion -based  system  tc  identify  the  key  result  areas  and  procedures  which 
will  help  achieve  those  results.  Such  a  research  effort  requires  the  direct 
involvement  of  experienced  recruiters  and  recruiting  managers,  the 
eq)plication  of  industrial  engineering  techniques,  and  the  involvement  of 
behavioral  scientists,  operations  researchers,  and  policy  analysts. 

Reward  system.  In  this  area,  the  key  to  effectiveness  is  an  incentive 
system  understood  and  perceived  as  attainable  by  the  entire  recruiting 
force.  Navy  recruiting  officials  have  modified  the  reward  system  which  was 
in  effect  last  fiscal  year.  However,  we  believe  that  adjustment  was  only  a 
first  step.  What  is  needed  is  a  separate  effort  which  allocates  goals  and 
provides  rewards  which  take  into  account  regional  differences,  including  the 
level  of  difficulty. 

Trajiniofl  and  development.  While  recruiters  represent  the  heai  t  of  the 
system,  the  training  and  development  of  the  recruiter  force  represents  the 
glue  that  binds  the  system  into  a  cohesive  whole.  However,  if  training  and 
development  programs  are  imposed  on  recruiters  and  are  interpreted  as  a 
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disciplinary  action  or  punishraent  for  inability  to  perfona,  there  will  be 
little  enthusiasffl  and  little  effective  training.  Additionally,  if  directive 
type  training  is  imposed  on  recruiters  who  are  overworked  or  under  a  great 
deal  of  stress,  that  training  is  likely  to  Interfere  with  effective 
learning.  The  two  factors  above  are  a  real  problem  to  C«?IC.  As  indicated 
in  NPRDC's  1989  recruiter  survey,  over  65  percent  of  the  recruiters 
perceived  that  the  tab  systaa,  vKhich  should  be  part  of  a  training  base,  is 
used  as  punishment;  over  a  third  of  the  force  believed  that  fear  and 
intioidation  are  the  norm  for  supervisors  and  chief  recruiters.  A  strong 
research  effort  is  needed  to  determine  the  actual  needs  of  the  recruiting 
force,  and  then  to  determine  how  to  effectively  administer  such  training, 
given  the  very  large  span  of  control  of  Navy  recruiting  supervisors  and  the 
geographical  dispersion  of  the  recruiting  force. 

CONCLUSION 

In  any  field,  job  performance  represents  the  measurement  of  success,  and 
the  formula  for  job  performance  is: 

Job  Performance  «»  Ability  x  Motivation  x  Opportunity 

This  fonmila  is  particularly  critical  in  the  recruiting  environment.  The 
coiribined  reviews  of  three  separate  study  groups,  supported  by  the  NPRDC 
survey  of  the  Navy  recruiting  force,  demonstrates  marked  deficiencies  in  the 
three  factors  vdiich  comprise  this  fonmila.  These  deficiencies  have  combined 
to  place  the  Navy  recruiting  force  under  a  great  deal  of  pressure  and 
subsequent  stress.  Substantial  research  is  needed  to  identify  effective  long 
range  solutions.  Senior  Navy  leadership  is  providing  the  opportunity  to 
develop  a  recruiter  research  agenda,  and  the  motivation  for  such  research  is 
strong  (to  help  solve  operational  difficulties  as  well  as  the  need  to 
satisfy  congressional  concerns). 

$Qm  may  challenge  the  need  to  conduct  such  research  due  to  the  probability 
of  greatly  reduced  recruiting  objectives.  We  must  understand  that  any 
reduction  of  recruiting  objectives  will  also  probably  be  met  with  reductions 
in  recruiting  resources.  At  the  same  time,  some  decision  makers  will  try  to 
raise  quality  standards  given  that  the  overall  numbers  are  reduced.  If  the 
reduction  in  goal  is  met  with  a  comparable  reduction  in  recruiters  or 
resources,  while  at  the  same  time  standards  are  tightened  in  a  more 
CMJpetitive  marketplace,  the  remaining  recruiters  will  be  forced  to  process 
even  greater  numbers  of  applicants  per  recruiter  to  achieve  mission,  thereby 
placing  even  further  stress  on  the  individual  recruiter. 
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Abstract 

This  report  presents  an  overview  of  results 
from  a  quality  of  work  life  survey  administered 
to  all  production  Navy  recruiters.  Ninety-four 
percent  responded.  Survey  responses  are  discussed  under 
the  following  topic  areas:  selection  and  training, 
goaling,  career  development,  and  quality  of  life. 


Projections  show  a  shrinking  manpower  pool  from  now 
through  the  first  few  years  of  this  decade.  Navy  recruiting 
policy  makers  must  decide  whether  to:  (1)  accept  lower 
quality  applicants,  (2)  pay  the  additional  cost  of  competing 
for  high  quality  youth,  or  (3)  fail  to  recruit  the  number 
and  q;^lity  of  required  recruits.  In  addition  to  the 
shrinking  manpower  pool,  general  unemployment  remains  low 
and  civilian  jobs  are  relatively  plentiful  in  most  areas  of 
the  nation.  Competition  for  qualified  people  continues  to 
increase.  Educators  «ind  school  counselors  do  not  view 
military  work  as  a  desirable  career  option.  This  results  in 
few  youths  considering  the  Navy  or  military  as  entry-level 
employment . 

Despite  these  obstacles,  the  Navy  recruiting  fores  has 
achieved  its  goals  in  both  the  quantity  and  quality  of 
accessions.  Unfortunately,  the  results  have  been  attained  at 
great  cost  to  the  recruiters  personally  and  often 
professionally.  The  quality  of  work  life  for  recruiters  has 
suffered  greatly  (Baker,  Somer,  &  Murphy,  1989) .  The 
Commander,  Navy  Recruiting  Command  (CNRC)  .  has  initiated 
several  short-  as  well  as  long-term  efforts  to  address  this 
situation.  Major  findings  of  the  1989  Navy  Recruiter  Survey 
relevant  tc  ioar  areas  of  organizational  life  which  are 
impacted  by  recruiting  duty  are  discussed  below. 

Results 


Selection  and  Training 

Recruiters  perceive  problems  in  connection  with 
determining  who  is  assigned  to  recruiting  duty.  The  rigors 
of  recruiting  assignments  demand  that  personnel  selected  to 
be  recruters  have  the  necessary  characteristics  that  will 
sustain  them,  and  that  their  family  and  financial  situations 
do  not  ha’iiper  their  performance.  Relevant  survey  results 
indicate  over  60  percent  of  recruiters  questioned  whether 
persons  who  have  the  proper  personality  and  motivation  are 
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selected  for  recroiting  (see  Figure  1) ;  84  percent  of  the 
recruit^s  agreed  that  the  Navy  should  develop  a  better  way 
to  select  recruiter  candidates.  Nearly  75  of  the  recruiters 
«^re  advised  by  former  recruiters  not  to  take  an  assignment 
to  recruiting  duty  and  60  percent  would  decline  to  advise 
friends  to  do  so;  B7  percent  agreed  that  recruiting 
duty  should  be  strictly  voliintary  (see  Figure  2)  . 
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There  was  a  general  i35>ression  that  the  training 
received  is  insufficient  for  those  who  are  selected  for 
recruiting  duty.  Respondents  indicated  that  they  were  not 
prepared  for  the  real  world  of  recruiting  or  for  the 
stresses  and  pressures  of  recruiting  duty.  They  recommended 
realistic  job  previews  to  improve  the  quality  of  work  life. 
There  was  also  a  strong  consensus  that  sales  training  they 
had  received  was  inadequate  and  that  additional  training 
wculd  be  helpful  (see  Figure  3) .  A  majority  responded  that 
training  which  allows  the  experiencing  of  failure  would  be 
beneficial  (see  Figure  4} . 
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Goaling 


P.ecraiter  success  is  measured  primarily  by  whether 
or  not  they  reach  their  goal.  Unfortunately,  nearly  75 
percent  of  the  respondents  report  that  they  do  not  have 
control  over  many  of  the  conditions  that  determine  if  they 
reach  their  goal.  Recruiters  agreed  that  the  1-month  goal 
period  is  too  short  (see  Figure  5) . 

Eighty-five  percent'  reported  that  they  felt  pressure  to 
continue  recruiting  even  after  they  had  made  their  goal.  No 
matter  if  their  accomplishments  one  month,  at  the  beginning 
of  the  next  month  the  pressures  returned.  To  ease  the 
pressure  on  individual  recruiters,  recruiters  strongly 
favored  the  team  concept.  Over  70  percent  believed  that 
station  personnel  should  be  organized  into  teams  so  that 
recruiters  could  specialize  in  the  aspects  of  the  job  they 
perform  best  (see  Figure  6) . 
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Figure  6. 


Career  Development 

In  the  area  of  career  development,  recniting  falls 
short.  Only  42  percent  reported  that  recruiting  duty  would 
help  them  advance  in  the  Navy.  Many  felt  that  recruiting 
would  hurt  their  chances  for  advancement  within  their 
rating.  One-third  of  the  recruiters  perceived  their 
evaluations  to  be  lower  on  recruiting  duty  than  tiiey  were 
bacX  in  their  occupational  field.  One-fourth  felt  their 
evaluations  did  not  reflect  the  effort  they  put  into  their 
recruiting  duties.  About  70  percent  agreed  that,  while  on 
recruiting,  job  pressures  have  kept  them  from  studying  for 
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■fchfeir  edv^cemont-  exams,  they  did  not  have  the  tinie  and 
xiiaterial  to  study,  and  they  should  be  relieved  of  goals  to 
study  for  advancement.  Recruiters  ranked  their  first  choice 
for  ii^provements  that  receive  extra  credit  at  any  selection 
ox  promotion  board  because  of  recruiting  duty. 

Recruiter  recognition  produced  mixed  responses.  Sixty- 
four  percent  agreed  that  they  received  recognition  for  good 
job  performance.  However,  over  half  claimed  they  received 
more  recognition  in  the  fleet  than  in  recruiting  duty. 
Nearly  eighty-eight  percent  of  respondents  suggested  that 
all  of  the  time  spent  on  reci-uiting  duty  should  count  toward 
sea  duty. 


A  career  ladder  for  recruiters  is  essentially 
nonexistent.  A  majority  (72%)  agreed  that  recruiters  should 
have  career  development  opportunities  within  recruiting 
after  they  have  demonstrated  their  abilities. 

Quality  of  Life 

Job  responsibilities,  naving  time  to  attend  to  personal 
matters,  concerns  about  finances,  and  availability  of 
support  systems  all  contribute  to  the  quality  of  life  for 
Havy  recruiters.  About  80  percent  of  respondents  reported 
much  stress  in  their  job  and  79  percent  agreed  that 
recruiting  was  more  stressful  than  other  Navy  jobs  (see 
Figure  7) . 
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Three-fourths  disagreed  that  their  work  schedule  left 
enough  time  to  take  care  of  personal  business.  Eight-five 
percent  reported  working  60  hours  or  more  per  week  with 
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nearly  half  of  the  respondents  putting  in  70  or  more  hours. 
Eighty- five  percent  disagreed  with  the  statement  chat  they 
were  compensated  for  working  holidays  and  extra  hours. 

Financial  matters  were  also  a  source  of  concern.  About 
70  percent  did  not  agree  that  the  variable  housing  allowance 
was  adequate  to  cover  their  living  expenses .  Personal 
expenses  for  medical  care  for  self  and  family  also  appear  to 
be  a  problem. 

Sixty  percent  of  the  respondents  disagreed  with  the 
statement  that  their  recruiting  district  provides  good 
quality  counseling  services  related  to  personal  and  family 
problems.  About  40  percent  of  the  recruiters  did  not  agree 
that  their  spouse-  g^rlfrisnd,  or  boyfriend  understood  the 
pressures  of  being  a  recruiter. 

Discussion 

Despite  the  obstacles  faced  by  the  Navy  recruiting 
force,  goals  for  the  quantity  and  quality  of  accessions  have 
been  achieved.  However,  the  cost  to  recruiters  has  been 
great  both  personally  and  professionally.  In  an  increasingly 
competitive  employment  market,  the  Navy  must  put  forth  the 
efforts  necessary  to  select,  place,  and  retain  highly 
qualified  individuals  in  the  recruiting  force.  Attention  to 
tJae  issues  that  concern  recruiters  will  impact  both  the 
productivity  and  quality  of  life  of  the  Navy  recruiting 
force. 
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Srief  Cognitive  Oriented  Group  Interve^^tlon  for  Treating 
Basic  Trainee  Adaptation  Ptobleas 
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Vilfcrd  Hall  USAF  Medical  Center 

Abstract 

This  study  reports  on  the  effectiveness  of  brief  cognitive 
behavioral  oriented  group  therapy  in  attenuating  minor  adjust¬ 
ment  problems  in  the  Air  Force  basic  training  environment. 

Outcome  data  in  terms  of  successful  or  nonsuccessful  completion 
of  training  is  reported. 

EiiListee  attrition  during  basic  training  has  traditionally  been  considered 
a  natural  element  of  the  training  regimen.  This  supposition  is  based  on 
the  assumption  that  the  young  inductee  comes  to  the  training  with  inherent 
psychological  and  physical  qualities  which  determine  success  or  failure 
when  faced  with  the  calculated  stressor  of  basic  training.  Fron  time  to 
time,  this  assumption  has  been  called  into  question  (Hovaco,  Cook,  &  Sarason, 
1983;  Buddln,  1988).  Literature  on  stress  snd  coping  strongly  sugggests 
that  successful  adapts tion  to  various  stressors.  Including  actual  combat, 
is  as  much  a  function  of  how  individuals  are  prepared  for  the  stressor 
as  their  inherent  adaptative  qualities.  Research  evidence  suggests  that 
simple  end  effective  psychological  procedures  exist  which  could  significantly 
reduce  attrition  in  otherwise  psychologically  healthy  individuals  (Butcher, 
a  Haudel,  1976).  As  defense  budgets  shrink  there  is  Creasing  support 
for  gaining  the  most  from  the  personnel  dollar  and  reducing  or  eliminating 
unneccessary  attrition  of  qualified  enlistees.  The  current  study  supports 
the  concept  that  short  and  efficient  psychological  methods  exist  which 
can  help  support  this  trend  coward  personnel  cost  conservation. 

Method 

Subjects 

Subjects  were  436  basic  trainees  who  were  previously  seen  for  command 
directed  evaluations  at  the  Behavioral  Analysis  Service,  a  dedicated  mental 
health  facility.  Subjects  were  evaluated  over  a  five  month  period  and 
determined  to  be  capable  of  returning  to  duty.  The  evaluations  indicated 
that  these  Individuals  would  benefit  from  brief  psychological  intervention 
to  increase  their  coping  skills  upon  return  to  training. 


Apparatus 

Group  sessions  were  provided  at  the  Behavioral  Aiuilysls  Facility  located 
in  close  proximity  to  the  training  area  at  Lackland  Air  Force  Base.  This 
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A  eoiafortable  relaxed  and  private  envlronae&t.  Each  group  of 
^pproxisately  15  iadlviduals  was  lad  by  a  suparvlalog  Ph.D.  level  psychologist 
-ahd  pce^dpctoral  resident.  A  psychiatry  technician  was  also  present  to 
toadle  adBlatstratlve  Issues  and  Bslntain  required  aedical  notes. 

Procedure 

Basic  trainees  were  first  evaluated  at  the  Behavioral  Analysis  Service, 
haaad  on  a  coooander  directed  referral,  and  determined  to  have  a  nondisqualifying 
dlagooais  but  with  some  degree  of  coping  problens.  Each  was  provided  an 
appointaent  and  recosoaendatlon  for  group  attendance.  Attendance  was  determined 
by  acquiescence  of  squadron  coaaander.  Subjects  were  routinely  checked 
for  whether  they  had  attended  group  end  their  graduation  or  discharge  status. 
Group  sessicms  consisted  of  two  one  hour  sessions  each  week.  Each  session 
involved  brief  inputs  from  ea^  member,  limited  problem  solving  and  supportive 
inputs  from  other  members  and  a  combination  of  paycboeducational  and  cognitive 
coping  inputs  from  group  leaders  (Heichenbaum,  1977). 

Results 

Analysis  of  outcome  data  for  the  subject  groups  collapsed  over  five 
months  contained  in  figure  1  clearly  supports  the  conclusion  that  group 
attendance  contributed  significantly  to  success  In  basic  military  training. 

In  the  group  of  individuals  who  attended  the  group.  177  (71. IZ)  graduated 
versus  68  (36. 4Z)  in  the  group  who  did  not  attend.  The  16  tot^  subjects 
imaceousited  for,  is  this  study,  ere  considered  insufficient  to  influence 
the  globivl  effect  fox  attendance.  No  accounting  was  made  of  the  nature 
of  dischaurgea  as  these  ere  generally  of  an  administrative  type.  It  is 
also  poei.ible  a  very  small  number  of  aedical  and  other  discharges  are  contained 
in  the  discharge  numbers  of  both  groups.  A  chi  square  analysis  showed 
that  attendance  was  significantly  related  to  graduation  and  no  attendance 
was  significantly  related  to  discharge  (p. <.003). 

Flguim  1 

Oroup  AttsndanBe  and  Trainlnii  Outoome 


ATTBiOeO 


NC  ATTENOANCe 


OiSCHARQtID 


Discussion 


One  conclusion  dravn  froa  the  current  8tu4j  is  that  a  relatively  ssall 
investment  ox  intervention  resources  can  produce  a  major  impact  on  individuals 
who  are  experiencing  a  significant  crisis  situation.  Trainees  attending 
the  group  averaged  tvo  to  £o^lr  sessions.  Total  active  involvement  for 
each  individual  la  estimated  to  be  no  more  than  five  ninutes  per  seaslon. 

HiIb  latter  observation  vould  auggeat  that  modallng,  mutual  support  and 
other  factors  hnoun  to  exist  in  group  situations  may  contribute  to  a  large 
degree  toward  the  outcome  found  in  this  study.  This  suggests  future  research 
to  determine  specific  intervention  elements  which  differentially  effect 
this  type  of  crisis  intervention.  Although  group  meahers  were  determined 
to  b*  quaUfiad  to  return  to  duty  and  training  the  question  arises  as  to 
their  capacity  to  complete  a  full  enlistment  (HcGraw  &  Bearden.  1988). 

Although  this  question  cannot  be  answered  in  this  study,  it  is  being  pursued 
end  viU  be  addressed  in  e  folloir^op  study  on  this  population. 

It  is  well  known  that  the  acute  crisis  element  involved  in  basic  training 
extends  into  mtdtlple  other  situations  which  are  common  in  the  military 
including  war,  dislocation,  natural  disaatars,  medical  evacuation  taama, 
survival  school  instructor  and  military  instructor  duty  and  the  like. 

The  impact  of  atrasaors  arising  from  such  sources  also  extend  to  the  femlliea 
of  ective  duty  personnel.  The  negative  impact  of  these  situations  are 
attrition,  increased  medical  costa,  diminished  morale  end  readineaa.  This 
study  suggests  that  modest  intervention  efforts  could  make  a  major  impact 
on  the  efor^tentioned  factors.  The  fact  that  calculated  savings  in  attrition 
costa  resulting  from  the  group  Interventicm  at  the  Behavioral  Analysis 
Service  are  close  to  tvo  million  dollars,  lends  strong  support  to  such 
a  conclusion.  This  alone  should  be  a  strong  incentive  for  fiurtber  research 
into  the  application  of  stress  interventions  for  mllitery  operations. 
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''  Interactive  Videodisc  (IVO)  technology  was  tested  as  a  valid 
teaching  technigue  in  conjunction  with  an  already  existing 
Interpersonal  relationship  skills  training  program.  A  group  of  Air 
.^Force  cadets  used  the  IVD  system  in  a  quasi  •-clinical  setting,  and 
ti»K^lr.  learning  was  steasured  in  terms  of  skill,  motivation,  and 
knowledge.  The  results  show  that  the  XVD  system  exhibited  a  positive 
influence  in  all  three  areas. 

Uord  processing  and  spread  sheets  have  already  demonstrated  the 
ij^ukct  of  coi^puters  on  the  industrial  community.  Now  there  is  an 
.e^.loslon  of  growth  in  computerised  education  and  the  leading  edge  of 

explosion  combines  both  computer  and  video  disc  technology.  When 
thau  technologies  are  yoked  together  by  Interactive  Videodisc 
HAftware,  they  form  *the  ultimate  educational  tool."  These  systems 
-are  revolutionizing  training  and  education  in  today's  business  world 
TCurrier,  1983).  Their  gxo^h  is  likely  to  increase  as  cosq^uters  and 
video  systems  become  cheaper,  more  powerful  and  more  widely  available. 
It  Is  important  that  this  new  technology  be  better  understood. 

Baihbridge  (1988)  has  cataloged  an  Impressive  set  of  IVD 
aacceS;Sea*  In  a  University  of  West  Florida  program,  students  using 
the  vi^deodisc  showed  a  25  percent  reduction  in  training  time  and  a  16 
pArdeiit  increase  in  the  number  of  students  vdto  passed  a  standard 
written  test  coB^c>ared  to  those  exposed  to  traditional  teaching 
methods.  Similar  results  were  found  by  Davis  in  the  Annenberg 
project.  She  found  that  students  took  less  time  to  complete  courses 
and  achieved  the  same  or  higher  scores  using  interactive  videodisc. 
In  addition,  a  National  Science  Foundation  study  found  college 
students  learning  biology  on  an  interactive  videodisc  system  took  37 
percent  less  time  to  complete  the  course  then  those  in  the  traditional 
classes  end  showed  significantly  higher  scores  on  the  post-test. 

The  use  of  interactive  videodisc  instruction  has  not  been  limited 
to  academic  settings.  Computer  based  training  (CBT)  has  become 
increasingly  popular  in  private  industry  and  goverment  agencies  as 
well.  In  1988,  the  Air  Force  Commissioning  and  Sducation  Committee 
(CKO  endorsed  a  proposal  to  examine  the  feasibility  of  using  IVD 
technology  to  enhance  professional  officer  development  (Eagle  Corp., 
1968).  The  comsdttee  wanted  to  use  IVD  technology  as  a  common  tool 
for  teaching  leadership  skills  to  officer  candidates  from  three 
different  commissioning  sources  (the  Air  Force  Academy,  Officer 
Training  School,  and  Reserve  Officer  Training  School).  The  committee 
decided  to  investigate  the  edocatipnei  effects  of  this  technology 
before  investing  development  funds.  Two  key  aspects  of  this 
investigation  where  1)  to  find  the  best  available  off-the-shelf 
software,  and  2)  to  explore  the  possibility  of  integrating  group 
process  with  this  new  technology. 

The  purpose  of  our  study  is  to  further  the  CEC  research  on  the 
use  of  IVD  technology  as  an  effective  educational  ^vcl,  and  to  look  at 
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the  poeslblt:  s^cSvantages  of  using  student  teams  t.o  proces^a  and  enhance 
the  IVD  program.  An  IVD  program  developed  for  teaching  ;.ntcrpersonal 
relation  skills  developed  by  Wilson  Learning  had  been  selected  and 
extensively  tested  (Porter  and  GuerrerO/  1989;  Porter/  Burtley,  & 
Guerrero,  1990).  This  IVD  program  was  integrated  into  the  Skills 
Training  Program  at  the  United  States  Air  Force  Academy.  The  purpose 
of  this  eight-week  program  was  for  cadets  identified  by  their 
commanders  as  having  interpersonal  skills  deficiencies  to  increase 
their  interpersonal  effectiveness.  Cadets  in  the  program  meet  weekly 
for  about  two  hours  to  work  with  a  counselor  to  develop  their 
interpersonal  skills.  As  with  previous  studies  (Porter/  Burtley,  & 
Guerrero,  1989}  the  Nominal  Group  Technique  was  employed  as  a  way  of 
using  group  interaction  to  enhance  learning  outcomes.  This  study 
involved  individual  self-assessment,  group  and  individual  performance, 
and  expressed  satisfaction.  Data  from  this  guasi-clinical  group  was 
compared  to  data  from  a  variety  of  other  groups  that  had  used  the  same 
ZVD  software  and  nominal  group  technique.  One  particularly  important 
aspect  of  the  IVD  program  is  that  it  provides  immediate  feedback. 
Yalom  (1985)  claims  that  through  feedback  and  self-observation,  one  is 
able  to  understand  his/her  own  behaviors  better  and  is  able  to 
appreciate  the  impact  of  that  behavior  on  others. 

Method 


SubjCfitS 

Three  female  and  three  male  cadets  ranging  in  age  from  16  to  22, 
Academy  freshmen  through  seniors,  served  as  subjects.  The  members  of 
this  group  had  volunteered  for  the  Skills  Training  Program.  The 
control  group  data  was  used  for  comparison  came  from  the  previous 
studies  with  cadet  and  officer  trainees  (Porter  &  Guerrero,  19S9). 
Comparison  group  subjects  had  used  the  same  techniques  and  technology 
that  were  employed  within  this  study. 

MJpaiAtug 

A  portable  Sony  View  Interactive  video  system  with  software  from 

was  Wilson  Learning's  Interpersonal _ ReifltlPDg  I _ Interacting  with 

Others  was  used.  Three  study-practice  units  in  this  package  covering 
developing  rapport,  listening  to  others,  and  displaying  sensitivity 
were  presented  during  the  first  session.  Each  unit  required 

approximately  15  minutes  to  complete  and  included  instruc^tion, 
demonstration,  evaluation,  and  feedback.  A  35  minute  comprehensive 
grand  practice  served  as  the  criterion  task.  The  grand  practice 
assessed  the  skills  of  the  students  on  all  three  of  the  study-practice 
units.  In  addition,  a  workbook  containing  15  self-essessment 

questions,  instructions  on  the  nominal  group  technique,  spaces  to 
record  individual  and  group  responses,  and  a  program  critique  was 
given  to  each  subject. 


Pr  nrerttire 


Two  groups  (one  of  two  subjects  and  the  other  of  four  subjects) 
were  used  to  conduct  the  training.  This  was  accomplished  daring  two 
sessions  separated  by  approximately  one  week.  The  two  groups  did  not 
Interact.  On  the  first  day,  subjects  were  given  an  introduction  by 
the  first  author  then  completed  the  interpersonal  relation  skills 
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seit-aasessaent  questions  aoJ  ¥»«£«  ^Iven  wzlcf  equipwCnr  cpcrsting 
instructions.  Hext,  the  students  coapleted  the  three  study-practice 
units  using  the  nominal  group  technique:  each  time  the  group  arrived 
at  a  decision  point  each  individual  marked  an  answer  in  his/her 
workbook.  Only  after  everyone  had  marked  their  Individual  response, 
could  the  group  discuss  the  problem  and  reach  consensus  on  the 
appropriate  response.  This  choice  was  marked  in  their  workbooks  and 
input  to  the  computer.  During  the  second  session,  the  subjects  again 
followed  the  same  procedure.  Subjects  then  individually  filled  out 
the  IVD  program  evaluation.  The  questions  on  this  evaluation  were 
designed  to  measure  three  different  outcomes:  skill,  knowledge,  and 
enjoyment.  Questions  tested  satisfaction  on  each  individual  category 
as  well  ats  overlapping  areas.  Responses  ranged  from  1  representing 
strong  disagreement  to  5  representing  strong  agreement. 

The  group  containing  the  four  cadets  was  also  timed  by  the  second 
author  to  more  precisely  examine  the  temporal  characteristics  of  each 
cadet's  participation  in  the  group  discussion.  The  sequence  of 
discussion  was  recorded  as  well. 

Results 

The  demographic  data  revealed  that  the  groups  had  both  low  grade 
point,  averages  (X«2.25,  83.139)  as  well  as  low  military  performance 
averages  (X«2.11,  s^.iiS).  Cadet  averages  on  both  of  these  measures 
are  about  2.75  with  a  standard  deviation  of  .50.  These  subjects'  low 
scores  document  low  performance,  however  they  do  not  necessarily 
validate  their  commander's  attributions  that  the  cadets'  deficiencies 
were  due  to  a  lack  of  Interpersonal  skills. 

Three  types  of  measurements  were  obtained  from  this  study.  They 
all  dealt  with  interpersonal  skills;  specifically  self-assessment, 
performance,  and  program  satisfaction.  The  means  and  standard 
deviations  obtained  for  each  of  these  three  categories  were  similar  to 
those  found  by  Porter  and  Guerrero  (1989).  On  a  scale  of  1  to  5  with 
1  being  below  average  and  5  being  outstanding,  the  scores  were  as 
follows:  building  rapport  (X>3.53,  8*0.97),  listening  to  others 
(X*3.35,  8*0.68),  displaying  sensitivity  (X*3.73,  s«l.ll).  These 
results  indicate  that  subjects  saw  themselves  as  having  interpersonal 
ekills  that  were  between  above  average  (3)  and  well  above  average  (4). 
Although  these  means  did  not  differ  significantly  from  the  control 
group,  all  were  slightly  more  positive.  Individuals  enrolled  in  the 
program  apparently  did  not  share  their  respective  commander's 
assesment  of  their  interpersonal  deficiencies. 

The  grand  practice  provided  the  performance  criterion.  The 
number  of  correct  responses  made  by  each  individual  before  and  after 
group  interaction  was  compared.  An  average  of  15.5  (s*1.4)  of 
subjects'  19  initial  responses  were  correct.  After  group  discussion 
and  consensus,  the  average  number  correct  was  17.0  out  of  19.  When 
these  scores  are  compared  to  those  obtained  from  other  groups  (Porter 
&  Guerrero,  1989)  they  are  slightly  superior.  The  subjects'  perceived 
interpersonal  deficiencies  might  not  be  perceptual,  but  could  reflect 
inactment  (behavior)  difficulty.  The  group's  89.5%  accuracy  reflects  a 
substantial  improvement  over  their  average  individual  auuutacy  u£ 
81.5%.  The  group's  influence  had  a  positive  effect  on  performance. 
On  10  of  the  IS  questions,  at  least  one  subject  changed  his/her 
individual  answer  to  match  the  appropriate  choice. 

The  group  of  4  cadets  was  also  measured  individually  In 
terms  of  the  amount  of  time  spoken,  the  percentage  of  times  the 
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i&aiV3.Qctai.  cnoice  racix;unt:vi  ukm  eventual  9£oup  cnsicc,  ana  me 
percentage  of  times  the  group  choice  matched  their  individual  choice 
given  that  they  spoke  last. 

Fig  1.  Subject  Speaking  Time  and  i  It  is  particularly  interesting  that 
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This  was  not  true 
W  or  Z  (Fig.  1). 
the  two  cadets  who  spoke 
than  half  as  much  as  their 
exerted  the  greatest 
on  the  group  decision, 
affective  reaction  to  the 
^training  was  measured  by  their  ratings 
^on  the  IVD  evaluation  at  the  end  of  the 
experisusnt.  High  scores  show  that  the 
students  were  very  satisfied  with  the 
progrzua.  No  significant  differences 
v»ere  noted  between  the  three  different  outcomes  (enjoyment,  skill,  and 
knowledge)/  but  this  might  reflect  a  ceiling  affect  due  to  the 
extremely  positive  ratings. 


Discussion 

These  results  are  generally  consistent  with  those  from  previous 
studies  (Porter  &  Guerrero,  1989;  Porter,  Burtley,  &  Guerrero,  1989) 
and  provide  some  support  for  using  this  technology  with  a  group  which 
had  been  identified  as  lacking  interpersonal  skills.  As  predicted, 
the  Interactive  Videodisc  system  was  an  effective  training  tool. 
Student's  were  extremely  satisfied  and  group  interaction  increased 
performance  and  nay  also  have  provided  useful  support.  From  the 
results,  we  know  that  in  the  group  of  4  cadets,  whenever  there  was 
dissension  between  the  individuals'  choices,  it  was  always  3  to  1. 
This  implies  that  v^en  one  of  the  three  spoke  to  the  group  they  were 
not  only  trying  to  influence  the  loner  but  were  positively  rein£o]:cing 
the  other  two  as  well.  This  reinforcement  may  account  for  the  high 
satisfaction  scores  obtained  on  the  evaluation.  As  Yalom  (1985) 
suggests,  the  Immediate  object  of  feedback  that  the  program  offered 
may  have  also  been  a  critical  contributing  factor. 

There  were  several  other  contributions  the  IVD  sessions  made  to 
the  Skills  Training  Program  which  were  less  obvious.  The  high 
technology  equipment  and  excellent  commercial  program  clearly 
communicated  institutional  committment  to  the  subjects  and  the 
importance  it  placed  on  developing  interpersonal  skills.  It  also 
provided  a  useful  variation  on  the  usual  group  counseling  format. 
Because  the  IVD  program  provided  both  structure  and  direction, 
counselors  could  gradually  withdraw  and  more  objectively  observe 
subjects'  interpersonal  skills.  Perhaps  most  importantly,  subjects 
were  able  to  have  some  fun  while  they  learned  something  about 
interpersonal  skills. 
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US.  Coast  Guard  Ac»iemy 


Abstract 


The  service  academies  of  ttie  Uidted  States  share  the  common  goal  of  grad* 
oosximisslcMed  ofikm  wdo  adhere  to  standards  (rf  conduct  dot  are,  in  turn,  based 
OQ  bn^  concepts  of  hon^  and  duty.  In  psactioe,  meeting  tMs  goal  should  mean  &at 
jpuhiates  adhm  to  rules  and  r^:ttlationa  in  both  public  situations,  where  their 
b^vktc  is  sul^»^  to  soudny  and  e^uatimi,  aed  private  sltuatkms,  inhere  *no  one  is 
watdhing.*  This  ^udy  examines  die  '‘rule  kee^dng”  bdwvior  of  graduates  of  the  U.  S. 
Coi#t  Guard  Academy.  The  CaHfmda  Fiydtobgical  Inventory  is  used  to  predict  the 
to  whidi  gitoiaates  follow  dte  r^lt^iiens  in  private.  Rule  keeping  behavior  is 
rdated  to  assessed  pezfonnance  of  these  officers  duriz^  their  time  as  cad<^  and  during 
the -first  two  years  following  their  graduation  fiom  the  Academy.  Finally,  the 
in^jfioaticms  of  these  findings  for  the  devek^toient  our  furine  leaders  is  considered. 


Eadr  of  foe  service  academies  is  characterized  an  ezduuastive  system  of  regulations.  These 
range  from  rules  antk^Mting  those  the  graduates  will  encounter  later  in  the  Unifimn  Code  of  Militaiy 
his^  (absence  without  leava>  disobedience  of  ordcss,  disrespect  to  senion,  etc)  to  extraordinarily 
to^zhdt  and  detailed  ndes  addressfog  foe  minutae  of  day  to  dlay  life  (e-g.,  r^uiaifons  stipulatii^  the 
predse  mamier  of  feeding  underwear  and  sods  and  their  oonect  piacenwnt  in  te  drasvers  of  foe  cadm' 
dkifionien).  The  service  academies  eadt  have  promulgated  an  additional  set  of  rules  foat  emphasize 
adherence  to  a  hlg^  standard  trf  ethical  bdtevior  th^  *honor  codes." 

If  detected,  violation  of  any  of  these  rules  results  in  punishment  Although  tlw  various 
academies  dito  somewhat  in  foeir  adnuninration  of  dheipUne,  sanctions  for  rule  breakers  typically 
i&dude  "demerits,"  extm  work  assignments,  restriedem  to  foe  aesdemy  grounds,  and  dismissal  fr^  the 
academy.  At  the  Coast  Guard  A^emy,  foe  total  number  of  demerits  received  by  each  cadet  is 
tabulated  and  beoemws  a  sigiuikant  part  of  his/her  overall  miliciry  evaluation;  accunnilation  of  a 
sufficient  nunfoer  of  demoits  (even  if  fo»e  are  due  to  a  aeries  (tf  minor  infiractkms)  can  eventually  result 
in  a  cadet's  dismssal  from  foe  academy. 


From  the  mi^thaais  placed  on  these  systems  of  regtilations,  it  may  be  inferred  that  rule 
adheru^  behavior  is  tegbly  valued.  The  smvice  academies  of  foe  United  States  share  foe  comnxm 
goal  of  graduating  commissioned  officers  who  adhere  to  wdl  defovsd  standards  trf  conduct  In  practice. 


meeting  foi*  8<Md  should  mean  foat  graduates  adhere  to  rules  ax%d  reguUtsons  in  public  situatioiu, 
where  ineir  oeniviur  is  SubjeCi  iu  aia'uuny  aiiu  evalumkii'i,  «im  psivalc  wituiuOui,  wu^c  *n0  Or«c  la 


watching."  We  draw  the  reader's  attention,  however,  to  foe  words  that  opened  the  preceding 
patagra|fo:  if  detected.  It  seems  at  least  twe  possible  outcomes  are  Hkdy  to  result  fiom  tlu  rdativdy 
isfimdble  and  demanding  system  of  rules;  at  the  end  of  fcnir  years,  foe  academic  graduate  either 


.£(»muMi6n«di  ofbcets  wlio  Bdkett  to  the  rules  or  officers  who  brealc  &e  rules  and  are  able  to  avoid 
-^teiectxon. 

An  index  baaed  sol^  on  the  nunibo'  of  recorded  infracficos  would  foil  to  distinguish  between 
these  groups.  This  paper  represents  on  effort  to  ascertain  the  actual  degree  to  which  academy 
graduates  adhere  to  nUes.  Sosndly,  it  examines  the  strength  of  the  relationship  between  rule 
adherence  at  the  academy  and  later  performamx  of  these  junior  officers.  Finally,  this  study 
investigates  the  degree  to  which  individual  di^rences  existing  at  entry  are  predictive  of  rule 
adhering  bdta\4or  duiitig  ihe  ensuii^  four  years. 


Method 


Sylasds 


TheQaasof  1986  numbered  250  when  they  entered  tlks  academy  in  July  of  1982.  Four  years  later 
138  graduated  (128  of  whidi  were  U.  S.  nationals).  }ust  pro:  U>  graduation  we  conducted  a  structured 
interview  of  76  cadets  adected  at  gaodr«n  from  the  cl^  In  the  summer  of  1W8  we  asked  eadi  of  the  lia 
US.  graduates  to  partiripatg  in  a  fiiUow-up  study;  120  of  these  agreed  to  participate  and  to  date  we 
have  ditained  oom|riete  perfonnonoe  records  fin*  100.  The  majority  of  incom^dete  records  are  due  to 
lags  in  the  performance  appraisal  system  whidi  seem  to  have  no  systematic  pattern  diat  might  bias 
the  results  of  dte  study.  Thirteen  of  Ote  graduafm  %veie  wtmten.  Nine^-four  percent  of  dw  graduates 
were2lQr22.  Only  five  were  minorities.  A  con^ete  data  set  forties  study  was  ^riained  for  42  sul^ects. 


Mp*KUTPft 


Undergraduate  Performance.  The  measure  of  undergraduate  perfonnance  was  dass  rank  whidh 
b  based  on  a  composite  of  acodonic  (75%)  and  military  (25%)  pi^onnance.  While  not  pure,  thb 
aiterkxt  b  much  idte  the  job  performance  aiteia  wed  in  job  sdecdon  studies.  It  u  a  mix  of  objective 
performance  and  style 

lob  Performance.  The  Coast  (^uard  assesses  die  perfonnanoe  ctf  ^mior  officers  every  six  mendts 
using  a  23  item  behaviotaIly>anchcMed  rating  scale  divid^  into  six  xnaloe  areas:  performance  of  duties, 
interperstmal  rdations,  leadership  skilb,  communication  skiUs,  perstmal  qualities,  and  effectiveness 
in  represoiting  the  Osast  Guard.  Each  major  area  b  followed  by  a  narrative  and  the  whole  report  b 
summarized  in  a  comment  of  the  officer's  leadership  and  potential  for  positions  of  higher 
responsibility. 


We  reviewed  the  perfonnance  repc.'ts  which  each  officer  received  during  the  two  year  initial 
assignment.  Four  distinct  patterns  emerged.  Hist,  an  officer  might  start  out  strong  and  continue  to 
perform  at  a  high  lev^  Thb  (rfficer  was  either  seen  os  a  natural  leader  with  great  value  to  the 
service  ta  seen  as  unique  in  the  rater's  experience  and  very  spedaL  Second,  an  cfficer  nugfit  start  slowly 
making  mistakes  and  demonstrating  some  weaknesses  but  devdop  rapidly  during  the  course  of  the  two 
years  firdshing  os  a  strong  oontribuior  to  effectiveness  of  the  unit  Third,  an  officer  might  be  a 
steady,  dependable  but  vinr^rrv^ricaUe  perJonr«^/  who  was  on  asset  but  not  the  key  to  nuxess.  Fourth,  an 
officer  might  demonstrate  weakness  that  p;rTi8ted  over  the  two  years.  For  some  the  evaluator’s 

r. ..  ^  ^  ^  1 1. .  ...  _  4  I  ...  A  ^  aL  ..  a  A  ^  ^  1  ...I  ^  -  -  -^O-  J  m  ••  a  ^  ^  jm-*  «  ^ iC,  •  S  ^  1 

UAt|^Ui  WC  UM84  UK  1K.V4^«V<  fuautCa  «/a  fwuata  bK  juCvwgoam  Lii  • 

denunding  assignment  These  were  margirial  performers.  Othns  were  judged  to  be  too  weak  for 
prcHnotion.  Th^  officers  foiled  to  be  pro  :noted  from  Ensign  to  lieutenant  (junior  grade)  at  the  eivi  of 
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ihe  usuaI  18  UBontib  trial  petfaxL  ](^  performance  for  the  two  yean  immediately  foUowixig  graduation 
wait  foeiefoee,  summanzed  by  foe  following  scale: 

5.  0^1*8)  CommeiUa  fodude  the  best  Tve  ever  seen,”  *  a  ristng  star,'  "innovations  wSl  benefit 
fiwmtiee  service."  Demonstrated  sttengfo  from  the  start,  no  weaknesses  noted. 

4.  Strong  foom  the  start,  exc^ent  initiative  and  stamina,  "maturity  unusual  fen-  an 

junior  c^ricer,"  recommended  for  command,  but  not  "the  best  ever." 

3.  (Na>29)  "S(^  perfotmer,"  may  have  minor  dif&ulties  at  the  start  but  exedient  record 
ovenU  by  second  year,  may  te  recommended  for  oommaiul  but  without  enthusiasm,  reports  are 
positive  but  lack  superlatives  and  exdtement 

2.  (Nail8)  Feniitent  flaws  that  io^wir  performance,  sgrtificam  co&uuEnd  attention  needed  to 
get  the  olucer’s  attentioit,  ctunments  indticfo  "slowly  improving,"  "recommetdetion  for 
oaonmand  wiflihdd  pending  further  gro'vth,"  "reconunffided  for  responsfole  positions  ashore." 
Not  reoopunended  far  command. 


1.  (NbT)  Failed  to  be  selecteri  for  promotion  to  Lieutenant  (jg)  or  evaluator  expaesses  serious 
doubts  that  this  officer  will  "make  It,"  comments  dearly  convey  negative  e^nluation,  e-g., 

"this  officer  is  la:^.* 

rjUfomis  Psychological  Inventory.  Each  student  entering  foe  Coast  Guard  Academy  is 
adodnistered  an  extenuve  battery  of  persorudity  inverUories  within  six  wedcs  of  arrivaL  The  results  of 
the  inventories  are  not  used  fcH'  screening  or  pdaoement,  but  are  retained  for  purposes  cf  individual 
oounading  aixd  institutional  research.  For  several  yea»,  the  standard  battery  has  included  the 
CaHfonda  Psychdogicsl  Inventory  (Gough,  1957, 1968, 1967a;  Megargee,  1972).  The  class  of  1986  was 
adnUnistered  the  48(Htem  version  of  the  CFI  in  the  suriuner  of  1982.  Scores  were  obtained  for  each 
studezU  on  the  eighteen  standard  "folk  coiKept*  scales  sivi  on  a  set  of  newiy  developed  "structural” 
scales  or  "vedors**'three  orfoogonal  scales  designed  to  measure  the  major  mterpersonal  themes 
uruieriying  foe  fdk  ctmeepts.  The  structural  scales  were  scored  on  foe  original  480-item  form  according 
to  iztstructiatis  stqrpUed  by  Gcntgh  fo  * 

Gough  describes  the  first  structural  scale,  v.l,  as  an  index  of  interpersonal  orientatioru  Low 
scorers  on  v.l  are  described  as  "active,  alert,  irtvolved,  and  extraverted'  while  high  scorers  are  "mote 
subdued,  private,  detached,  and  introverted".  (Gough,  1987b>  Among  the  folk  concept  scales,  it 
ccnrrdates  highly  wifo  DoxninaiKe,  Capacity  for  Status,  Sociability,  Social  PreserKe,  Self  Acceptance 
(corrdatiotte  range  from  -  to  -30). 


Aoemding  to  Gough,  v2  is  a  measure  of  the  respondeiU'sncnnative  orientation.  "This  ooirtinuum 
goes  frmn  a  norm-doubting,  skeptical,  artd  non-confonnist  perspective  at  one  pole,  to  a  norm-accq>ting, 
acquiescetU,  and  rule<ompUant  orientation  at  foe  other."  (Gough,  198^).  Its  highest  positive 
correlatioia  amoitg  foe  folk  concept  scales  are  with  Sodalizatioti,  Rreponsibility,  Aduevement  via 
Conformaitoe,  and  Good  Impresaion  (correlations  range  from  £7  to  32).  It  also  correlates  relatively 
highly,  though  isegativdy,  ^th  Flexfi^ty  (1^34  for  males  aiui  r»-30  for  females). 


Gough  oSen  v3  as  a  metMire  of  "a  range  of  fuifiUznent  or  realization  ...  proceeding  from  self- 
defetting  and  inadequate  resoUiticn  of  problems  and  potentialities  specific  to  that  type,  up  to  an 
actualized  and  ego-erfoandng  integratkm."  ((3ough,  1988,  p.  2)  It  corrdates  highly  with  virtually 
every  one  of  the  folk  concept  scales  except  Femininity  (r»,02  for  men,  r*-.13  for  women)  and 


JfBSV  AV4 


W«c:  VASaaviM 


(for  Tolemivce  aitd  Aduevement  via  Ii^depeitdence)  to  r-AO  (for  Flexibility). 


ia\/a«a  a* 


Rate  Keeping  Behtvion  Coast  Cturd  Academy  regulatioiis  are  divided  into  three  categories. 
The  least  "offensive*  tnunsgressioM,  Class  HI,  inctud'ng  such  dungs  as  a  poor  shoeshine  and  ^dies 
impiopefiy  folded.  Class  II  odbaaes  indude  missing  class,  inattention  to  duty-  and  gross  de&sencies  in 
appearanoe.  In  dds  study  we  asked  cadets  hi  a  structun»l  interview  to  identify  whidi  of  the  41  listed 
Gass  1  (Senses  they  had  conunltted  without  'getting  caught’.  Qass  I  oftenses  are  the  most  serious 
oftesses  and  Indude,  for  escan^e,  cheating,  telsi^dng  records,  AWOL  arei  sexual  xrusconduct 


Results 


The  number  oi  separate  Class  I  offenses  ktoidfied  ranged  hxsmi  to  25  with  a  mean  of  73.  There 
are  only  two  significaiu  intercorrdations  among  all  of  the  meastues.  The  first  is  t^ween  Uie  CFl  .scale 
v2  and  the  number  of  sdf  reported  Qass  I  offenses  (rs -AO).  The  secend  is  the  corrdatiofi  between  Qa&s 
Rank  and  Ferfonnanoe  (oer)  after  graduation  (f»-29).  None  of  the  other  relationahips-neither  the 
relationsh;^  between  the  number  of  Class  1  ofteues  and  overall  academy  performance  nor  the  re- 
lationahipa  between  the  number  of  Class  I  offenses  and  performance  after  graduation-wete  significant 


Table  1 


v.l 

v.2 

v3 

oer 

Rank 

Oass  1 

-.15 

-.60** 

-.17 

.10 

Qass  Rank 

-.05 

-.05 

-.08 

-39* 

p<  Al 
p<  .001 


Dtscusaio;i 


The  magnitude  of  the  correlation  between  v.2  and  die  number  of  reported  Class  I  offenses  is  not 
surprising.  The  normative  orientation  scale  was  developed  to  measure  a  factor  that  has  emerged  on 
virtually  all  factor  anal)rMs  of  the  CFL  Its  constituent  scales  generally  reflect  such  themes  as  soda! 
cotifoimity  and  sdf  discipline.  The  number  of  Qass !  offenses  provides  a  good  measure  of  the  degree  to 
wluch  the  stuiknts  abide  by  the  rules  of  the  organization  or,  conversdy,  reject  those  rules.  More 
surprising,  perhaps,  is  the  lack  of  a  rdationship  betweoi  the  Class  I  offdi^  and  overall  performance, 
assessed  either  during  the  cadets'  tune  at  the  Academy  or  after  didr  graduation. 

The  tect  that  the  number  of  Qass  I  oftenses  committed  is  predict^le  but  not  predictive  raises  a 
host  of  questions  concerning  the  match  between  cur  standards  and  our  objectives.  Peihaps  the  most 

/TitMHQn  Z!>?32Xing  of  AT’5  TSising  S 

oemform  in  public  but  whose  personal  standards  are  at  odds  with  the  norms  and  values  of  die  service^ 
and  what  if  we  are? 
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Abstract 


A  study  of  job  satisfaction  sim  career  intentions 
of  more  than  30,000  Air  Force  personnel  provided  support 
for  traditional  laodels  of  tumovar  as  well  as  indicating 
several  significant  differences  between  military  and 
civilian  subgroups. 


High  attrition  rates  in  the  Air  Force  (Finstuen  &  Berry,  1981;  Ward 
&  Tan,  1985)  have  placed  increased  eiqxhasls  on  etxamining  those  factors 
which  may  provide  additional  insight  into  understanding  the  underlying 
attitudes  of  individuals  who  either  raoain  in  or  leave  the  military.  Of 
particular  concern  are  the  factors  in  tlmir  environment  which  may  eventu¬ 
ally  cause  them  to  be  attracted  away  from  their  present  situation  or 
repelled  away  due  to  dissatisfaction  with  some  aspect  of  their  job 
(Niebuhr  &  Dansby,  1986). 

In  examining  turnover  models,  research  has  focused  on  the  impact  of 
job  satisfaction  and  career  intentions  relative  to  turnover  decisions 
(Steers  &  Howdiy,  1981).  Recent  path  analysis  research  suggests  that 
personal  and  organizational  characteristics  appear  to  influence  job 
satisfaction,  subsequently  affecting  organisational  commitment,  career 
intentions,  and  eventually  actual  turnover  (Michaels  A  Spector,  1982; 
Williams  &  Hazer,  1986).  Both  job  satisfaction  and  organizational 
eexamitment  appear  to  be  intervening  variables  in  the  turnover  process, 
and  it  Is  apparent  from  the  above  studies  and  others  (Martin,  1980;  Steel 
St  Ovalle,  1984)  that  the  best  predictor  of  turnover  is  the  employee's 
intention  tc  leave.  Within  the  military  setting,  career  intention  is 
also  the  strongest  predictor  cf  reenlistaent  decisions  (Ham  &  Hulin, 
1981). 

Two  of  the  antecedent  attitudinal  variables  examined  in  these  recent 
path-analytic  studies  are  perceived  job  characteristics  and  leadership. 
Reviews  cf  research  have  generally  supported  the  models  that  suggest  that 
both  job  characteristics  (Loher,  Noe,  Moeller,  6t  Fitzgerald,  1985)  and 
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{3ass,  1981)  affect  both  job  attitudes  and  behavior.  Tasks 
vhiich  ace  perceived  to  be  more  r^ttivating  (due  to  the  presence  of  skill 
variety,  antonomy,  feedback,  task  identity,  and  task  significance)  and 
situations  in  which  the  leader  is  store  supportive  suggest  higher  levels 
of  satisfaction.  Turnover  models  recognize  that,  over  time,  job 
satisfaction  nay  be  related  (directly  or  indirectly)  to  turnover 
intentions  and  turnover  actions. 

Organization  tenure  (length  of  time  in  the  organization)  has  been 
shotm  previously  to  be  positively  related  to  job  satisfaction  (Herman, 
Dunan,  &  Hulin,  1975;  Spenser  &  Steers,  1981)  and  is  viewed  as  inversely 
related  to  the  propensity  to  search  for  new  job  opportunities  (Steers  & 
Mowday,  19S1). 

Based  on  support  for  current  models  of  turnover  it  would  be 
anticipated  that  motivating  Job  characteristics,  supportive  leadership, 
and  seniority  would  be  positively  correlated  with  Job  satisfaction,  and 
to  a  lesser  degree,  with  intentions  to  make  the  military  a  career.  In  a 
review  of  turnover  studies  Steel  and  Ovalle  (19SA)  found  that  studies  on 
military  samples  consistently  resulted  in  greater  attitude-tumover 
relationships  than  studies  In  civilian  populations.  Consequently,  it 
would  be  predicted  that  the  correlates  with  job  satisfaction  and  career 
intentions  for  both  officers  and  enlisted  personnel  would  exhibit  stron¬ 
ger  relations  than  those  of  the  civilian  eiiq>loyees. 

Method 

Data  for  the  present  study  came  from  the  Leadership  and  Haixagement 
Develoiatent  Center  (LHDC)  Organizational  Assessment  Package  (GAP)  data 
base  of  alBx>st  300,000  survey  respnses  collected  in  LMDC  management 
consultation  visits  to  Air  Force  o,. janizations.  The  surveys  were  adaain- 
Istered  from  October  81  to  July  85  as  a  census  of  organizations  (usually 
wing  size  or  equivalent)  at  65  bases  or  sites  where  UfDC  was  invited  to 
consult.  Surveys  were  administered  in  group  sessions  and  respondents 
were  assured  of  individual  anonymity  of  responses.  Only  LMDC  consultants 
handled  completed  survey  response  sheets.  Respondents  for  the  present 
study  were  a  31,980-person  segment  of  the  data  base,  chosen  to  provide  a 
representative  sample  of  functional  areas  (operations,  maintenance,  and 
resources)  and  personnel  categories  (officer,  enlisted,  and  civilian). 

The  OAP  provides  an  Overall  Leadership  scale  of  nineteen  items. 

The  Task  Motivation  scale  is  c(»iprised  of  five  subscales  and  calculated 
in  a  multiplicative  model  developed  by  Hackman  and  Oldham  (1976).  The 
Job  Satisfaction  OAF  factor  consists  of  seven  items  and  has  been  shown  to 
be  reliable  (Short,  1985).  Career  Intention  was  measured  uslvig  a  single 
OAP  item,  and  Saniorlty  was  derived  from  the  demographic  section  of  the 
OAP. 


Table  1 


l>escrlptive  Statistics,  Reliabilities,  and 
Interccrrelations  Among  the  Study  Variables 


M 

SD 

1 

2 

3 

\  ir-  •'  • 

1. 

Overall  Leadership 

4779 

1.46 

(.97) 

2, 

Job  Characteristics 

109.56 

65.79 

.33 

(.75) 

•A." 

3. 

Job  Satisfaction 

5.07 

1.16 

.50 

.50 

(.81) 

♦ 

4. 

Career  Intention 

3.74 

1.31 

-15 

.27 

.30 

■ 

5. 

Seniority 

4.88 

1.87 

.01 

.25 

.10 

Reliability  coefficients  are  in  parenthesis  in  the  diagonal.  All 
correlation  coefficients  above  .02  are  significant  at  the  .001  level. 

Table  2  provides  the  results  of  the  correlational  analysis  between  job 
satisfaction  and  career  intention  tor  the  three  personnel  categories 
(officers,  enlisted,  and  civilian),  tihile  Table  3  details  the  analysis  of 
the  correlates  under  study  for  both  of  these  variables. 

Table  2 

Correlations  Between  Job 
Satisfaction  and  Career  Intention 

Officers  .28 

Enlisted  Personnel  .29 

Civilians  .24 


Table  3 

Correlates  of  Job  Satisfaction 
and  Career  Intention 

Correlates  with  Job  Satisfaction 
Leadership  Job  Characteristics  Seniority 


Officers 

.49 

.53 

.05 

Enlisted 

.49 

.49 

.08 

Civilians 

.54 

.40 

.08 

Officers 

Enlisted 

Civilians 


Correlates  with  Career  Intentions 
Leadership  Job  Characteristics  Seniority 

.14  .23  .43 

.15  .25  .48 

.10  .17  .17 


Discussion 


The  results  from  analysis  of  the  data  did  provide  partial  support 
for  the  first  hypothesis  by  finding  that  leadership  and  Job 
characteristics,  two  of  the  three  correlates  examined,  were  more 
positively  correlated  with  job  satisfaction  than  with  career  intention. 
Seniority,  however,  was  more  related  to  career  intention  than  to  job 
satisfaction,  possibly  a  result  of  the  strong  pension  benefits  available 
to  military  retirees  and  the  recognition  that  an  "exit"  decision  occurs 
only  at  intervals  (e.g.,  every  4  years)  rather  than  in  a  continuous 
fashion.  Consequently,  one  would  expect  that  after  several  decisions  to 
reenlist,  many  military  personnel  would  be  coaiaitted  to  make  the  service 
a  career.  Examination  of  Table  2  provides  further  support  for  this 
rationale  of  a  discrete  versus  continuoiis  evaluation  of  staying  in  the 
organization.  The  correlations  between  seniority  and  career  intention 
for  both  officers  and  enlisted  personnel  (.43  and  .48,  respectively)  are 
much  higher  than  the  correlation  for  civilians  (.17).  Although  the 
potential  of  more  external  opportunities  for  civilians  might  be  a  second 
caiisal  factor  for  this  lower  correlation,  certainly  the  lack  of  a  dis¬ 
crete  reenlistment  coaaitoent  decision  appears  to  have  some  merit  for 
explaining  the  difference. 

The  data  in  Table  3  provida  mired  support  for  the  hypothesis  that 
the  correlational  relationhips  will  be  stronger  for  the  military 
population  than  for  civilians.  Four  of  tue  six  comparisons  did  find 
fairly  strong  differences  among  the  military-civilian  samples.  Examining 
only  the  attitudinal  variables  (leadership  and  job  characteristics)  three 
out  of  four  of  these  military-civilian  comparisons  support  the  hypothesis 
that  greater  relationships  would  exist  for  the  military  population.  The 
ability  to  leave  the  organization  at  any  time,  the  perceived  potential  of 
TBore  external  employment  opportunities,  and  the  recognition  that  they  are 
non-military  personnel  in  a  military  organization  are  possible 
explanations  for  the  civilian  population  having  weaker  correlational 
results . 

The  resvilts  of  this  stiidy  in  a  military  environment  do  support  the 
traditional  turnover  models.  While  only  slight  differences  were  found 
between  the  results  for  officers  and  enlisted  personnel,  the  decrease  in 
relationships  for  civilians  suggest  that  further  investigation  of  this 
subgroup  is  warranted.  Particularly,  emphasis  should  be  placed  on 
insuring  that  civilians  perceive  the  military  environment  as  a 
contributing  factor  in  their  professional  development.  In  examining  the 
subsequent  careers  for  social  scientists  in  the  military  Clausen  (1984) 
foimd  that  a  proper  professional  environment  was  a  source  of  superb 
I>ostgraduate  training  and  experience  and  resulted  in  establishing 
stimulating  friendships  and  professional  ties  for  the  future. 
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h.  Behavioral  Obaervation  Scale  ror  the  Acadeay  Training  Philoeophy 

Major  Michael  A.  Rosebush,  Ph.B. 

USAF  Acadeoy 

Abstract 

The  United  States  Air  Force  Acadeay*  s  (USAFA)  standardized 
definition  for  how  all  aupervlcors  assigned  at  USAFA  are  tc  treat  their 
subordinates  is  described  in  a  set  of  guidelines  known  as  the  "Academy 
Training  Phlloscphy*  (ATP).  The  researcher  developed  a  Behavioral 
Observation  Scale  (BOS)  in  irtjich  subordinates  could  assess  how  often 
they  perceived  their  supervisor  was  applying  various  ATP  behaviors. 

Mine  empirical  teats  were  conducted  on  the  BOS  for  ita  reliability  and 
validity.  Regarding  reliability,  the  five  subscales  of  the  BOS  had 
internal  consistency  coefficient  alpha  values  ranging  fre-u  .86  to  .93. 
Additionally,  the  Instrusent'a  intraolass  correlation  on  sets  of  four 
raters  was  .37,  which  proved  to  be  higher  than  the  intraclass 
correlations  concurrently  measured  on  the  previously  validated  Job 
Descriptive  Index  (JDI) .  Regarding  validity,  a  test  for  content 
validity  ravaalad  that  for  each  of  the  BOS  items  at  least  70$  of  the 
judges  could  accurately  reallocate  the  item  back  to  its  original 
aubacale.  Evaluations  of  the  instrument*  a  concurrent  validity  revealed 
correlations  of  .71  and  .63  respectively  with  the  JDI's  Joh-irwOeneral 
end  Supervision  scales,  and  .80  with  a  global  supervisor  effectiveness 
scale  known  as  the  Supervisor  Evaluation  Queetlons.  Regarding  construct 
validity,  the  test  for  oontamination  on  each  item  revealed  at  least  70% 
of  the  judges  believed  tbs  item  satisfactorily  discriminated  supervisory 
effectiveness.  Additionally,  a  multlple^groxip  method  factor  analysis 
ahewad  44  of  the  Instruoant*  s  4B  items  loaded  more  heavily  on  the 
expected  subscale  than  any  of  the  other  four  subscales.  Finally,  there 
was  a  significant  samipartlal  correlation  between  the  InstrtiiBent' s 
appraisal  of  the  supervisor  and  the  subordinates'  current  military 
performance  (after  the  subordinates'  previous  cumulative  performance  had 
bean  partisled  out  of  the  current  Basester' s  parforoonce)  for  freshman 
subordinatas,  but  not  for  upperclasa  subordinates. 

The  United  States  Air  Force  Academy  (USAFA)  utilizes  the  Academy 
Training  Philosophy  (ATP),  developed  by  Rosebush  end  Bryant  (1984),  as  the 
model  for  how  all  supervisors  assigned  to  USAFA  are  to  behave  when  leading 
subordinates.  The  ATP  model  asserts  that  there  are  five  key  principles  which 
need  to  be  applied  by  the  supervisor  in  order  to  instill  in  the  subordinate  a 
string  desire  to  ezcall.  These  five  principles  aret 
1 .  Set  clear  EXPECTATIOMS  for  subordinates 

R.  Teach  subordinates  the  necessary  ^ILLS  to  accomplish  assigned  taska 

3.  Provide  F£EDBAQ(  to  subordiztates 

4.  Provide  appropriate  COIISSQUENCES  coeasensiurate  with  the  feedback  given 
3.  Establish  GROVIH  opportunities  for  the  subordinates 

ihe  UsAiA  manual  Applying  the  Academy  Training  Philosophy  (RoBebuah, 
1985)  describes  in  specific  detail  to  superrisors  how  to  actually  apply  each 
of  the  five  ATP  principles,  and  this  manual  is  taujht  to  all  cadets. 

The  ATP  is  not  only  the  model  for  supervision  at  the  USAFA,  but  it  is 
also  the  model  for  the  O.S.  Coast  Guard  Academy,  and  is  being  used  in  varlouo 


vtfs  at  Air  Force  Officers  Training  School  and  Squadron  Officers  School. 
Deojiite  the  aideapread  uee  of  ATP  in  aany  major  training  centers,  there  had 
ne/er  been  developed  a  perforoanca  appraisal  rating  scale  for  measuring  how 
wall  a  ojpervisor  was  applying  ATP  (as  determined  by  the  immediate 
Mibordlxiataa) . 

While  there  are  numerous  methods  for  de/elcping  valid  performance 
appraisal  instrumanta,  one  of  tha  moat  p^ular  ani  respected  is  the 
behavioral  observation  scales  (BOS)  method.  The  BOS,  developed  by  Latham  and 
Wexley  (1977)  is  a  procedure  for  scale  construction  that  attempts  to  measure 
the  frequency  with  which  certain  critical  bei-isvlora  aure  observed  by  the 
ratar.  An  advantage  of  th»  1^)3  is  that  items  are  behavioreil  in  nature, 
thereby  describing  specifically  what  the  supervisor  must  do  more  or  less  of. 

The  purpose  of  the  research  was  to  develop  a  BOS  type  of  performance 
appraisal  which  measured  from  ths  subordinates’  perspective  how  well  the 
supervisor  was  applying  the  principles  of  the  ATP.  In  order  to  develop  such 
a  scale,  tbe  researcher  went  through  numerous  scale  development  steps, 
followed  by  empirical  testa  of  the  instrument' s  reliability  and  validity. 

Method 

Tbe  methodology  used  in  this  research  involved  a  series  of  siuveys  given 
to  groups  of  cadets  from  the  USAFA,  using  field  i>rocedures. 

Subjects 

Five  different  groups  of  cadets  were  surveyed  for  the  purpose  of 
instruT^ent  davelopment  end  validation.  Mo  cadet  particlpatsd  in  more  than 
one  group,  while  all  cadets  were  randomly  aelec'b«d.  Croup  #1  consisted  of  93 
cadets  who  were  very  familiar  with  iSSt  and  who  were  used  to  help  write  the 
original  pool  of  648  posaible  itass  for  the  instrument.  Group  #2  ccnslsted 
of  76  cadets  who  conducted  both  a  ”reallocatl(»  test*  (a  form  of  content 
validation)  and  a  "test  for  contasinatlon*  (a  form  of  construct  validation) 
on  tbe  117  non- redundant  items.  Croup  #3  consisted  of  64  cadets  who 
conducted  further  teats  for  contasinatlon.  Group  #4  oooalsted  of  243  cadet 
aubordinatas  who  rated  their  respective  supervisor,  using  an  initial  version 
of  tbe  instrument  whlJh  consisted  of  65  itams.  Finally,  Group  #5  consisted 
of  264  cadet  subordinates  who  rated  their  respective  supervisor  using  the 
final  48- item  instrument. 

I  net  rumen  ts 


There  were  a  total  of  five,  reaearcheiv developed  surveys  given  in  the 
development  and  empirical  validation  of  the  BOS  instrument.  Survey  #1  was 
given  to  Group  #1  ,  and  required  those  cadets  to  write  items  which  they 
believed  were  critical  in  defining  ATP  behavior.  Survey  #2  was  given  to 
Group  #2,  requiring  those  cadete  to  reallocate  each  item  back  to  the  original 
subacale  from  which  the  item  was  originally  written.  Additionally,  Survey  #2 

conduct  sl  Tov  con^fcAsins'^i-on  on  ^sch 

determine  whether  the  item  could  discriminate  good  from  bad  supervisors. 
Survey  #3  was  given  to  Group  #3,  requiring  those  cadets  to  also  conduct  a 
test  for  contamination.  Survey  #4  was  given  to  Group  #4  for  the  purpose  of 
collect?aig  data  on  65  items  in  order  to  conduct  an  item  analysis  to  shrink 
the  instrxxaent  down  to  its  final  size.  Survey  #5  was  the  instrument  In  its 
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filial  48**it6iB  Bl2e,  and  trajs  given  to  Group  #5  for  the  purpooe  of  empirical 
TalldaiiiQn. 


Survey  #1  Has  given  to  Group  #1  in  order  to  have  cadets  moat  familiar 
Hltb  AIF  define  the  behaviors  whieh  they  believed  vere  the  most  critical  in 
defining  each  of  the  five  AIP  subscalee.  This  procedure  produced  848  items 
from  the  93  cadets*  The  researcher  eliminated  redundant  Itesa,  thus 
producing  117  Items.  The  117  items  vere  then  tested  on  Group  #2  by  using 
Survey  #2  to  see  if  the  items  could  be  properly  reallocated  back  to  their 
original  ATP  nibscale  from  which  they  vere  vrltten.  Additionally,  Surveys  2 
and  3  were  given  to  Groups  2  and  3  to  see  if  each  item  vas  free  from 
"contamination"  (i.e.  capable  of  discriminating  good  from  bad  supervision}. 
The  results  of  these  tests  of  reallocation  and  oontamination  provided  the 
researcher  with  the  empirical  basis  to  reduce  the  iastrument  down  to  63 
items.  The  63~ltea  Survey  #4  vss  given  to  Group  #4,  where  each  of  the  243 
cadet  subordinates  rated  their  respective  supervisor.  The  researcher  then 
conducted  an  item  analysis  of  the  results  of  Survey  #4 ,  and  shrunk  the 
instrument  down  to  its  final  48*' item  size.  Survey  #3  (l.e.  the  final  48*- item 
instziAent)  uns  given  to  Group  #5t  and  these  264  cadet  subordinates  rated 
their  respective  supervisor.  The  results  of  Survey  #3  served  as  the 
ampirlcal  evaluation  of  the  final  instrument*  a  reliability  and  validity. 

Results 

The  final  ATP  instrument  (l.e.  Survey  #3)  was  given  to  Group  #3,  and  a 
total  of  nine  separate  empirical  validations  ware  conducted  to  assess  its 
reliability  and  validity.  Regarding  reliabllityt  the  instrument*  s  five 
suhseales  were  measured  for  Internal  conalstency  by  determining  their 
coefficient  alpha  valums.  i  ooefflelsnt  alpha  value  of  .80  is  commonly  used 
as  a  criterion  for  adequate  internal  consistency  (Lathaa  &  Vezley,  1931 }  and 
all  five  of  the  ATP  aubacales  met  this  criterion,  ranging  in  values  from  .86 
to  .93. 

Another  reliability  test  was  the  instrument’ s  intraclass  correlation 
coefficient,  which  measured  the  degree  of  consistency  between  groups  of 
niters,  if  these  groups  were  to  have  rated  the  same  supervisor.  The 
intraclass  correlation  on  the  instrument  proved  to  be  .37,  which  was  higher 
than  the  intraclass  correlation  of  two  previously  validated  scalea  for 
measuring  suparvlaion  (l.e.  two  of  the  Job  Descriptive  Index  scales)  —  which 
vere  concurrently  measured  along  with  the  Al?  Instrument. 

Several  tests  of  the  instrument’  a  validity  were  conducted.  The  ATP 
instrument  was  concurrently  validated  against  two  scales  from  Ihe  Job 
Descriptive  Index  (JDl)  (Smith,  Kendall,  &  Hulin,  1932)  *—  the 
"Job-livGeneral”  scale  and  the  "Supervision"  scale.  The  JOI  is  the  most 
widely  used  instzrusant  in  research  fcr  asaessing  supervisory  effectiveness 
and  is  considered  by  aany  to  be  the  most  valid  and  reliable  instrument 
available  in  the  area  of  supervisiKii  The  ATP  instrument  correlsted  ^71  with 
the  JDI’a  Job- In-General  scale  and  .65  with  the  Supervision  scale.  The  ATP 
instrment  was  also  concurrently  validated  against  a  third  scale  (known  as 
the  "Supervisor  Evaluation  Questions”  —  a  global  asseasment  of  e 
supervisor's  overall  effectiveness),  and  the  correlation  was  .80. 


v&lidatlcm  of  the  ATP  ijsstrument  involved  conducting  a 
coi^^rt^tlon  teat  to,  detexiaioe  if  a  supervisor*  8  score  on  the  ATP 
xnu5  significantly  related  to  increased  ailitary  performance  by  the 
J^jlhjhordin^tss  (after  the  subordinates*  previous  cumulative  military 
c  d^^vOEBahoe  had.  been  accounted  for) .  The  results  indicated  that  there  uas 
:  aignifioant  relationship  for  all  subordinates  (l.e.  upperclass  and 

^^r(Mk23K«n  subordinates) »  but  there  was  a  significant  relationship  for  the 
fresl^n  asijboxdinates. 

,  The- raallocaticn  test  (i.e.  a  form  of  content  validation)  shoved  that  on 
each  item  at  leaat  703(  of  the  Judges  could  accurately  reallocate  the  item 
back  to  its  original  subaoale.  The  results  of  the  test  for  contamination  cn 
ei^ch  itM;  revealed  at  least  70^  of  the  Judges  believed  the  item 
aatlafaetorily  discriainated  supervisory  effectiveness.  A  final  validation 
of  the  ATP  instrument  involved  a  multiple-group  method  factor  analyaiB  to 
confirm  if  an  item  loaded  moat  vith  the  ATP  subscale  frea  vhich  ths  item  vas 
originally  derived,  or  if  the  item  errmeoualy  loaded  higher  on  one  of  the 
other  four  ATP  aubscalea.  Fozrty-four  of  the  48  items  loaded  highest  on  their 
•correct*  A3P  subscale. 


Ciscuasicn 

The  purpose  of  the  research  vas  to  develop  a  reliable  and  valid 
Behavioral  Obaervaticn  Scale  performance  appralaal  Instrument  vhsre 
subordlnatea  could  aaseas  the  frequency  in  which  their  respective  axipervisor 
applied  certain  behaviors  endorsed  in  the  Academy  Training  Philosoi^y.  The 
researcher  had  preestabllahed  nine  criteria  which  the  ATP  iiustruaent  should 
have  been  able  to  aeet  to  denonstrate  its  reliability  and  val.i.dlty.  All  nine 
of  the  criteria  were  aet*  Specifically .  the  instrument  desori^trated 
reliability,  as  shown  by  ita  adequate  internal  cooslstency  (i.s.  coefficient 
alidha  values  greater  than  *80),  and  between^ rater  reliability  (us 
dMonatrated  by  having  an  intreolssa  correlation  higher  than  e'i^/nar  scale  of 
the  JBI,  when  concurrently  measured). 

The  instrusent  also  demonstrsted  content,  concurrent,  and  construct 
validity.  Specifically,  content  validity  was  deaonstrated  through  use  of  the 
Critical  Ittcidant  Technique  (Flanagan,  1954)  of  it^  generation,  plus  having 
ail  items  on  the  ATP  instrument  capable  of  being  properly  reallocated  TO^C  of 
the  time.  Concurrent  validity  was  demonstrated  by  having  correlations  of  .71 
with  the  JDI's  Job-lz>-General  scale,  .6^  with  the  JBI's  Supervision  scale, 
euad  .30  with  the  Supervisor  Evaluation  Questlotxs  scale.  Additionally, 
concurrent  validation  was  demonatrated  by  abowing  that  there  was  a 
statistically  significant  relationship  between  a  supervisor*  s  score  on  the 
ATP  instrument  and  improved  military  performance  in  the  freshnen  aubordinates 
(althwigh  there  was  not  a  siguif leant  relationship  when  considering 
upperclass  subordinates) .  Finally,  the  instzument  demonstrated  construct 
validity  by  having  each  item  satisfy  a  test  for  contamination  70$  of  the 
time.  Additionally,  the  multiple-group  method  of  factor  analysis  confirmed 
that  44  of  the  48  iteon  on  the  instrument  loaded  highest  on  the  correct  ATP 
subscale: 

These  results  provide  eztrwsely  positive  evidence  for  the  instrument*  s 
reliability  and  validity.  While  there  are  some  limitations  idtich  need  to  be 
considered  (i.e.  the  degree  of  generalizability  that  this  Instrument  has  with 
other  populations,  further  work  needed  on  exploratory  factor  analyses,  etc,). 


it  does  appear  that  ths  tnstnajeat  effectively  aeaeures  {from  the 
subordinates’  perspectives)  how  well  a  supervisor  is  applying  the  principles 
of  ATP. 

This  research  indicates  that  institutions  which  are  currently  using  the 
Academy  Training  Philosophy  (e.g.  USAFA,  Air  Force  training  centers,  the  U.S. 
Coast  Guard  Academy,  etc.)  might  be  wise  in  using  this  ATP  Instrument  to 
assess  supervisor  effectiveness.  This  instrument  could  also  be  used  by 
institutions  which  are  not  currently  using  A'R’,  as  a  means  of  assessing 
whether  their  superviscre  are  applying  ATP- type  behaviors.  If  such 
Institutions  discover  that  their  supervisors  are  scoring  low  on  the  ATP 
instrument  then  such  data  could  provide  impetus  for  developing  a  training 
program  which  focuses  on  ATP  principles.  There  exists  the  potential  for  much 
more  research  using  the  ATP  instrument.  ?or  instance,  does  the  instrument 
demonstrate  reliability  and  validity  at  other  training  centers  where  ATP  is 
currently  practiced?  Uhat  about  other  service  academies?  Another  intriguing 
area  of  Investigation  Involves  the  generaliaability  of  the  ATP  ixistniment  to 
actual  Air  Force  units  or  civilian  units.  Perhaps  the  instrument  can 
effectively  measure  superviaory  effectlvenesa  at  a  wide  range  of  settings, 
but  only  f\irther  research  can  answer  that  question. 
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Abstract 

Workers'  self-reports  of  job  characteristics  such 
as  autonooy,  skill  variety*  task  feedback*  task 
significance*  and  task  identity  have  been  reliably 
related  to  self-reported  worker  satisfaction.  As  a 
result*  a  goal  of  aany  job  redesign  efforts  has  been  to 
increase  worker  not i vat ion  by  increasing  these 
characteristics  in  jobs.  Critics  have  charged,  however, 
that  the  worker  perception  -  worker  attitude 
relationship  is  largely  due  to  cotn^n  method  bias 
inherent  in  self-report  aeasureoent  methods.  As  a 
result,  a  more  definitive  relationship  between  job 
perceptions  and  actual  job  design  is  desirable  in  order 
to  (a)  assess  the  validity  of  workers'  perceptions  of 
job  characteristics*  and  (b)  provide  a  more  objective 
basis  for  job  redesign  interventions.  This  study,  using 
canonical  correlation  analysis*  found  that  workers' 
perceived  job  characteristics  were  significantly 
related  to  independently  measured  characteristics 
derived  from  job  analysis. 

Jobs  that  are  enriched  (i.c.*  have  high  levels  of  skill 
variety*  task  identity*  task  significance,  autonony,  and  feedback 
from  the  job  itself)  tend  to  be  associated  with  desirable  job 
attitudes  and  performance  (Hackman  &  Oldham,  1975;  Loher,  Noe, 
Moeller,  a  Fitzgerald,  1985).  controversy  has  surrounded  these 
relationships,  however,  because  cf  the  potential  for  common 
method  bias  when  using  self-reports  of  job  characteristics  as  a 
basis  for  job  redesign  and  as  predictors  of  job  attitudes  (see 
e.g.,  Roberts  a  Click,  1961).  As  a  result,  there  is  a  need  to 
validate  job  characteristics  rated  by  incumbents.  The  literature 
suggests  at  least  four  Independent  criteria  that  can  be  used  to 
validate  workers'  perceptions  of  job  characteristics:  (a) 
experimentally  created  job  designs  (typically  in  a  laboratory 
setting),  (b)  convergence  among  rating  sources  of  job 
characteristics  (e.g.,  peers,  incumbents,  supervisors, 
observers),  (c)  significant  differences  between  job  groups  in 
rated  characteristics,  and  (d)  results  of  job  analyses.  This  last 
method,  job  analysis,  would  appear  to  be  the  auei.  pcteuLially 

^  This  paper  was  based  on  the  author's  dissertation  research 
under  the  direction  of  Professor  Eugene  F.  Stone,  Ph.D. 


ttMiol  £ox  providing  input  into  tbe  job  redesign  process;  and  is 
the  focus  op  study  in  tbe  present  research.  Tbe  research 
objective  was  to  deteraiine  if  relationships  existed  between 
comiooLy  measured  job  characteristics  (used  in  job  rc;design  and 
worker  perception-attitude-behavior  theory  building)  and  job 
characteristics  derived  from  independent  job  analysis. 

Method 

Subjects 

A  total  of  223  military  and  civilian  workers,  representing 
four  distinct  organizations  and  16  job  classifications, 
participated  in  the  study  as  raters  of  perceived  job 
characteristics.  In  addition,  34  members  of  the  respective 
organizations  served  as  job  analysts.  Table  1  lists  the  subject 
and  job  samples. 


Table  1 


Participants  bv  Organization  and  Job  Title 


Organization 


Humber  of 


Job  Title 


Analysts 


Workers 


Food  Process 
Air  Hational 
Guard 


Packaging  Supervisor  2 

Materiel  Facilities 
Supervisor  2 

Avionics  Technician  3 

Aircraft  Armament 
Systems  Technician  2 

Jet  Engine  Technician  2 

Tactical  Aircraft 
Maintenance  Technician  4 


3 

12 

II 

5 

19 


United  States 
Air  Force 


County  Sheriff 


sore  Instructor  3 

Recruiter  2 

Inventory  Management: 

Demand  Processing  2 

Inventory  Management: 

Mission  Capability  1 

Development  Engineer: 

Electronics  2 

Oevelopawnt  Engineer: 

Aeronautical  2 

Traffic  Safety  Officer  2 

Criminal  Investigator  2 

Patrol  Officer  2 


13 

20 

7 

3 

12 

12 

10 

23 

69 


Totals: 


16 


34 


223 


rSfggSUrgS 

Tbe  researcher  compiled  items  from  Hackman  and  Oldham's 
(1974)  Job  Diagnostic  Survey  and  Stone  emd  Gueutal  (1985).  Based 
upon  principal  components  analysis,  a  unit-weighted  composite 
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'  .mea«ur«  luu&sd  Job  coaplexlty  was  created  from  measures  of  skill 
Vryariets,  task  identity,  task  significance,  autonomy,  feedback 
from  the  job  itself,  and  intellectual  demands.  In  addition, 
uorkers*  perceptions  of  public  interaction  and  service, 
dangerouftness,  and  physiceLl  demands  were  also  used.  ?he  job 
analysis  technique  used  was  the  Position  Analysis  Questionnaire 
(ffcCoraick  et  al-,  1969).  The  PAQ  ratings  were  scored  to  produce 
13  overall  job  dimensions.  The  reliabilities  of  the  PAQ  ratings 
and  job  perception  ratings  were  assessed  prior  to  the  canonical 
analysis  emd  found  to  be  satisfactory. 

Results 

The  data  in  Table  2  represent  the  canonical  solution  relating 
workers'  perceptions  of  job  characteristics  with  the  overall 
dimensions  derived  from  job  analysts*  PAQ  ratings.  Three  of 
the  four  canonical  functions  were  statistically  significant.  The 
greatest  characteristic  root  (i.e.,  the  square  of  the  canonical 
correlation  between  the  first  pair  of  canonical  variates)  and  the 
subsequent  roots  were  tested  for  significance  with  degrees  of 
freedom  as  described  in  Harris  (1985).  The  squared  canonical 
correlations,  however,  indicated  the  amount  of  variance 
explained  in  the  pairs  of  canonical  variates,  not  the  original 
variables.  In  order  to  interpret  the  substantive  rtatuxe  of  the 
variates  in  terms  of  the  original  variables  and  to  assess  their 
predictive  efficiency,  five  indicators  were  computed:  canonical 
regression  coefficients  (Harris,  1985),  structural  coefficients 
(Meredith,  1964),  variance  matrix  coefficients  (Dunham  s 
Kxavetz,  1975),  redundancy  coefficients  (Stewart  &  Dove, 

1963),  and  the  squared  aeml-partial  correlation  (Darlington, 

1968)  between  each  original  variable  emd  its  opposite  variate. 

The  entries  in  TadJle  2  represent  the  structure  matrix,  i.e.,  the 
correlations  between  original  variables  and  the  canonical 
variates  (Meredith,  1954). 

The  redundancy  coefficients  indicated  that  three  canonical 
variates  of  the  PAQ  overall  dimensions  predicted  60%  of  the 
variance  in  the  perceived  job  characteristics;  and  the  three 
variates  of  the  perceived  job  characteristics  accounted  for  51% 
of  the  variance  in  the  PAQ  overall  dimension  scores. 

The  first  canonical  function  clearly  appeared  to  represent 
a  physical  demands  and  dangerousness  dimension.  Incumbents  who 
perceived  their  jobs  as  physically  demanding  and  dangerous  also 
worked  in  jobs  characterized  by  job  analysts  as  requiring 
operation  of  machines  and  equipment,  engaging  in  physical 
activities,  and  working  in  unpleasant,  hazardous,  and/or 
demanding  environments. 

The  second  root  indicated  that  jobs  rated  by  workers  as 

Auw«:xa%,>w  Awxi/ avx  V  ax&w  aaut^u  uiubu 

on  PAQ  items  associated  with  public,  customer,  and/or  related 
contacts  and  lew  in  supervising,  directing,  and  estimating. 

The  third  function  appeared  to  represent  job  complexity. 
Incumbents  who  rated  their  jobs  high  in  characteristics 


job  coDplexiny  e.l.so  were  found  by  job  analysts  to  have 
z<iguisr  work  schedules  with  low  aaiounts  of  task  routine  and 
repet itivenees.  In  this  sample*  workers  on  regular  day  schedules 
perceived  their  jobs  as  more  enriched  than  those  on  atypical 
schedules*  who  performed  tasks  rated  as  more  routine/repetitive 
by  the  job  analysts. 


Table  2 

Canonical  Correlation  Analysis  of  P 


Perceived  Job  Characteristics  (P3C) 


Overall  Dimensions  with 


Can(»iical  function 
Canonclal  correlation 
Squ»xm6  canonical  correlation 


I 

.92 

.65*** 


II 

.78 

.61*** 


PAO  Canonical  Variates 
Overall  Dimensions 

1.  |}ccision*  communicating* 

a  general  responsibility 

2.  Operating  machines  & 

equip&ient 

3.  Performing  clerical/remted 

activities 

4.  Performing  terhnical/related 

activities 

5.  Performing  sexvice/related 

activities 

£.  Working  regular  day  schedules 

7.  Performing  routine/repetitive 

activities 

8.  Being  aware  of  work  environment 

9.  Engaging  in  physical  activities 

10.  Suparvieing/directing/estimating 

11.  Public/customer/related  contacts 

12.  Onpleasant/hazardous/dem:  naing 

environment 

13.  Mon-'typical  work  schedule 
Redundancy  coefficients: 


PAQl 

PA02 

T 

r 

.40 

.45 

.64 

-.25 

.71 

.38 

.61 

-.29 

.39 

.26 

-.79 

-.06 

.67 

.  13 

.84 

.19 

.88 

-.19 

,  .16 

-.67 

1  .28 

.71 

.88 

-.06 

.54 

.20 

(  .37) 

(  .08 

PJC  Variate 


Perceived  Characteristics 


Job  complexity 
Public  interaction 
Physical  demands 

uaiug  «  iC  u  srieii  a 
Redundancy  coefficients 


Hote ;  N  =  223.  Entries  a^s  structural  coefficients 

*“*?  .0001 


r 

£ 

23 

-.07 

21 

.92 

94 

-.i3 

Discussion 

The  use  o£  canonical  correlation  allowed  for  the  relatively 
subjective  concepts  of  perceived  job  characteristics  to  be  linJ(ed 
«ith  more  objective  job  content  indicators  derived  from 
independent  job  analysis.  This  linkage  provided,  in  the  sample 
studied,  a  validaticr  of  tbs  workers'  perceptions  of  their  jobs 
using  job  analysis  criteria.  This  study  also  provided  support  for 
a  three-*difflensional  portrayal  of  parceved  job  characteristics 
similar  to  the  Stone  emd  Gueutal  (1985)  dimensions  derived  from 
Bulti-diaensional  scaling.  Finally,  the  methods  employed  in  this 
research  may  be  useful  for  job  redesign  efforts  by  providing  more 
specific  targets  for  consideration  for  redesign  through  the  use 
of  the  PAQ  items  associated  with  the  overall  dimensions. 
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Abstract 

The  quality  of  perforaance  ratings  is  coaimonly 
assessed  with  indices  of  rater  errors  such  as  halor 
leniency,  and  restriction  of  range.  At  the 
group  level,  convergent  and  discriainaat  validity  also 
provide  evidence  of  rating  quality.  In  addition  to  the 
above  measures,  this  study  utilized  rating  accuracy  and 
true  halo  aeasuxca  and  examined  relationships  between 
these  Indicators  of  rating  quality.  It  was  concluded 
that  rater  "error*  measures  could  not  serve  as 
meaningful  indicators  of  rating  inaccuracy  or  validity. 
I«eve].8  of  true  halo  in  rated  performance  need  to  be 
considered?  as  well. 

As  their  nano  ieplies,  rater  errors  have  been  taken  as 
indicators  cf  racing  inaccuracy.  These  errors  include  such 
measures  as  halo,  leniency,  and  restriction  of  range.  Halo  has 
been  defined  as  the  failure  to  discriminate  among  potentially 
distinct  dimensions  of  performance.  Leniency  can  be  defined  as  a 
mean  rating  above  the  scale  midpoint;  and  range  restriction  is 
th«  failure  to  discriminate  among  ratees.  What  these  traditional 
rater  error  measures  have  in  common  Is  a  reliance  on 
distributional  assumptions.  Fox  example,  both  halo  and  range 
restriction  assume  some  optimal  degree  of  variability  in 
ratings.  In  the  case  of  halo,  the  smaller  the  variability  cf 
ratings  across  dimensions,  the  greater  the  halo.  For  range 
restriction,  the  variability  is  assessed  across  ratees:  the 
smaller  the  variability,  the  greater  the  range  restriction. 
Likewise,  leniency  and  severity  can  be  defined  as  negatively 
skewed  and  positively  skewed  rating  distributions,  respectively. 
Hone  of  these  rater  error  measures  depend  upon  a  known  true 
value  for  the  level  or  range  of  ratings  for  defining  rating 
quality.  AS  a  result,  they  have  been  described  as  indirect 
measures  of  rating  quality.  That  is,  the  true  levels,  and 
distributions  of  performance  cannot  be  known.  Arbitrarily,  then, 
scale  midpoints  and  normal  distributions  are  used  as  criteria 
against  which  observed  ratings  ace  compared.  This  rationale  has 
been  the  basie  of  Pater  Error  Traiuing.-  in  which  raters  are 
taught  to  normally  distribute  t.heir  ratines. 

An  alternative  approach,  free  of  a  priori  distribution 
assutoptions,  ie  rater  accuracy.  Ratings  are  compared  to  a  known 
true  or  target  criterion  value  for  the  performance  being 
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evaluated.  Tbe  ratiog  accuracy  approach  has  been  used  nostly  in 
laboratory  and  rater  training  settings  in  which  performance 
acaiiarips  can  be  videotaped  or  wrictext.  The  means  cf  expert 
ratings  are  then  obtained  and  serve  as  true  scores. 

Use  of  videotaped  or  written  performance  stimuli,  for  which 
true  scores  are  known,  permits  examining  whether  or  not  rater 
error  measures  actually  do  represent  rater  inaccuracy,  as 
traditional  interpretation  assumes.  Empirical  studies  to  date 
have  suggested  both  paradoxical  (positive  correlations}  as  well 
as  the  expected  negative  correlations  between  rater  error 
measures  and  rating  accuracy.  In  addition,  with  true  scores 
known  for  each  rating  dimension,  the  true  halo  for  a  given  ratee 
or  group  of  ratees  can  be  determined.  True  halo  can  then  serve 
as  a  criterion  for  determining  the  amount  of  halo  error  in  the 
obtained  observed  ratings. 

The  present  study  examined  the  interpretability  of  rater 
error  aeasures  when  cos^red  to  rater  accuracy  scores  and 
convergent  and  discriminant  validity  indices. 


Method 

8ub1eets 

Two-hundred  and  ninety-three  subjects  completed  this  study. 
All  subjects  were  students  enrolled  either  in  introductory 
psychology  or  business  administration.  The  average  age  of  the 
subjects  was  19  years,  and  approximately  two-thirds  were  female. 

Materials 

Videotapes.  Eight  videotapes  of  actors  delivering  classroom 
lectures  (and  the  true  scores  associated  with  each  performance; 
thirphy  et  al.,  1982)  were  used  in  the  present  study. 

Rating  Scale.  Each  lecturer  was  rated  on  eight  performance 
dimensions  on  a  scale  of  1  (Very  Bad)  to  5  (Very  (k»od). 


Procedures 

All  subjects  were  shown  a  randomly  selected  set  of  four  of 
the  eight  videotapes.  While  viewing  the  tapes,  raters  were  not 
permitted  to  take  notes. 

Measures 

The  following  rater  error  scores  were  computed  for  each 
rater:  Observed  Halo  (OH),  Halo  Error  (HE),  Absolute  Halo  Error 
(AHE),  Observed  Leniency  (OL),  Leniency  Error  (LE),  and 
Restriction  of  Range  (RQR).  Rating  accuracy  scores  for  each 
rater  were  computed  using  the  formulas  of  Cronbach  (1955)  for 
Elevation  (EL),  Differential  Elevation  (DEL),  Stereotype 
Accuracy  (SA),  and  Differential  Accuracy  (OA).  At  the  group 
level,  measures  of  convergent  and  discriminant  validity  were 
computed  using  the  multi-trait  multi-rater  techniques  of 
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Kavaoagb,  MacEinney/  and  Woline  (1971).  See  Tallarigo  (1987)  for 
core  detail  on  procedures  and  aeasurenent  methods  used  in  the 
original  study. 


Results 

Interpretation  of  Rater  Errors 

Table  1  presents  the  means  and  standard  deviations  for 
halot  leniency  and  true  halo.  A  number  of  observations  are 
noteworthy.  First,  the  overall  mean  level  of  True  Halo  was  quite 
high.  In  Pearson  correlation  form,  the  overall  True  Halo  was 
approximately  .95  (Fisher's  z  transformation  =  1.83).  Second, 
the  interpretation  of  halo  and  leniency  differs  depending  on 
whether  true  scores  are  considered.  For  example,  as  can  be  seen 
in  Table  1,  the  Observed  Leniency  measure  indicated  that  raters, 
on  average,  were  neither  lenient  nor  severe  in  their  ratings, 
using  the  scale  midpoint  as  a  criterion.  But  when  true  scores 
were  uced  as  criteria  for  assessing  leniency,  the  majority  of 
raters  were  severe  in  their  ratings,  as  indicated  by  a  mean 
leniency  error  that  was  negative.  The  percentage  of  raters 
exhibiting  leniency  dropped  from  approximately  one-half  to 
one-quarter  when  the  definition  of  leniency  changed  from  using 
the  scale  midpoint  to  using  the  overall  true  score  mean.  In  a 
similar  manner,  the  interpretation  of  raters'  halo  tendencies 
changed  depending  on  its  definition.  The  mean  Observed  Halo 
indicated  a  high  level  of  halo  in  the  ratings  (i.e.,  the  mean 
interdimension  correlation  was  .79).  According  to  traditional 
interpretation,  raters  failed  to  discriminate  sufficiently  among 
the  performance  dimensions.  But  Halo  Error  levels  (i.e.. 

Observed  minus  True  Halo)  indicated  that  raters  discriminated 
too  much.  That  is,  mean  Halo  Error  was  negative.  The  majority  of 
subjects  (88%)  exhibited  negative  halo  error,  I.e.,  observed 
halo  lower  than  true  halo.  Thus,  one  can  arrive  at  differing 
conclusions  regarding  rating  quality  depending  on  whether  or  not 
true  scores  are  considered  in  the  definition  of  rater  error. 

Table  1. 

Descriptive  Statistics  for  Halo  and  Leniency _ 

_ _  _ M  SD 


True  Halo 

1.83 

.63 

Observed  Halo 

1.07 

.57 

Halo  Error 

-.76 

.70 

Observed  Leniency 

.01 

.39 

Leniency  Error 

-.28 

.39 

Note;  All  n's  «=  293.  Halo  values  are  in  Fisher  z  form. 

Relationships  between  Rater  Error  and  Rater  Accuracy 

The  traditional  interpretation  of  rater  errors  would 
presume  that,  as  classes  of  variables,  rater  errors  are 
negatively  correlated  with  rating  accuracy.  The  results  in  Table 
2  clearly  indicated  that  this  was  not  the  case  in  the  present 
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'4Ata.  B^ccept  for  DEL  «ccur)tc.v»  Oba«rved  Halo  was  positively 
corralateo  with  aecoracy.  ¥he  one  bignif leant  relationship  for 
‘CHi.s^sved  Iienieiu:y  was  positive;  and  for  Range  Restriction,  one 
si^'ificant  correlation  was  negative  and  one  positive.  Osing 
Halo  srror  as  an  iiodicator  of  accuracy  was  also  inadequate.  But 
using  the  absolute  value  of  Halo  Error  (i.e.,  Absolute  Halo 
Szror}  produced  more  consistent  results:  the  two  significant 
relationships  were,  as  expected,  negatively  related  to  accuracy. 


Table  2 

Correlations  between  Rater  Error  and  Rater  Accuracy  Scores 


Rates  Error  Scores 

Rater 

EL 

Accuracy 

DEL 

Scores 

SA 

DA 

Chserved  Halo 

.25*** 

-.23*** 

.28*** 

.45*** 

Halo  Error 

.07 

-.19*** 

.13** 

.34*** 

M^iolute  Halo  Error 

-.07 

.02 

.19***  - 

.35*** 

tt»erved  Leniency 

.63*** 

.06 

.07 

.04 

Leniency  Error 

.80*** 

.06 

.13 

.06 

Ranoe  Restriction 

-.25*** 

.22***  - 

.08 

.11 

Note:  EL  »  Elevation  accuracy;  DEL  *  Differential  Elevation;  SA 
>  Stereotype  Accuracy;  DA  >  Differential  Accuracy.  N  »  293. 

**  p  <  .01  ***  p  <  .001 

Relationships  at  the  Group  Level 

There  were  39  unique  groups  of  raters  in  the  present  study. 
Bach  group  was  exposed  to  oi\e  of  14  levels  of  true  halo  in 
videotaped  perfornances.  This  analysis  axaained  correlations 
between  rating  quality  indices  and  true  halo,  convergent,  and 
disexiainant  validity  after  averaging  the  rater  error  and  rater 
accuracy  scores  within  each  of  the  39  groups. 

Effects  of  True  Halo.  The  cotrelatiors  in  Table  3  suggested 
that  levels  of  true  halo  were  positively  correlated  with 
convergent  validity  aiui  observed  halo,  negatively  correlated 
with  range  restriction,  and  unrelated  to  discr iaiiiant  validity 
and  rating  accuracy.  Also,  the  true  halo  levels  did  not  appear 
to  affect  the  rating  accuracy  scores. 

Correlates  of  Convergent  and  Discriminant  Validity.  Neither 
the  rater  error  nor  the  rater  accuracy  scores  correlated  with 
the  validity  indices  in  a  unifom  oianner.  However,  the  accuracy 
scores  appeared  more  consistent  than  the  error  measures  in  that 
all  of  the  correlations  between  accuracy  and  validity  were 
positive.  The  rater  error  scores,  however,  were  more  mixed  in 
their  correlations  with  the  accuracy  scores. 


va 

as 

Difgarentiai  Accuracy  .04  .09 _ .23  _ 

Mote;  n  «  39.  Signs  o£  correlations  with  remge  restriction  and 
accuracy  scores  are  reversed.  CV  ^  conver^i-nt  validity;  DV  = 
discrininant  validity. 

*  p  <  .05  **  p  <  .01  ***  p  <  .001  ****  p  <  .0001 

Discussion 

This  study  Buggested  that  interpretation  of  rating  quality 
Buist  consider  the  degree  o£  true  halo  and  true  perforsunce 
levels  inherent  in  each  ratee  saaple.  The  decision  as  to  how 
■uch  leaiencyj  halo»  or  range  restriction  is  excessive  is 
relative  to  the  true  score  distribution.  Accuracy  scores 
appeared  to  perfoca  better  thau;  traditional  rater  error  scores 
in  tb'S  present  study.  Although  the  use  of  accuracy  scores  in 
durational  perforaance  evaluation  settings  is  not  practical, 
their  use  in  rater  training  has  been  successfully  demonstrated 
in  other  research. 
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Abstract 


Ethics  issues  are  present  In  uncertain  situations  virhere  muftlpte  Stakes, 
l^erasta  md  values  are  in  oonAict  and  rubs  and  standards  are  undear.  Managers 
oonUtsudly  engage  in  det^sion  making  that  a'Uicts  tiw  fives  and  weii-being  of  others, 
thia.  they  sre  involved  in  ethicai  decision  making.  There  is  limited  research  vrtuch 
mtempdi  to  understand  value  systems  In  the  oontsxt  of  the  decision  making  process.  This 
rasaarch  is  the  peefiminary  axaminatlon  of  eopousad  values  and  behavioral  outcome, 
and  proposes  a  nmv  taohnique  for  the  measurement  of  ethical  devebpment. 


Tto  ir^erest  in  viAies,  integrity,  and  ethica!  behavior  is  viewed  by  mai^  as  a  recent 
phenomenon.  Thb  rertewed  popularity  ^  (kre,  to  a  targe  exleiit.  to  the  reported  abuses  and 
scandals  of  busirtosses.  The  stories  of  lying,  brbes.  false  reports  and  payoffs  are  just  a  sampie 
of  the  adverse  pudidty  on  which  ttte  pu^  judges  organizations.  Because  the  public  has  given 
busbwss  a  tow  grade  in  honesty  and  trustworthiness,  sodety  is  demanding  that  businesses  and 
tncSviduals  address  the  issue  of  ethics.  Society  is  demancSng  that  business  took  farther  than  just 
economic  issues  and  thtf  ttiey  be  .'esponsive  to  others  besides  stockholders.  This  area  of 
responstoilily  is  atoo  receiving  attention  from  the  U.S.  Cortgress  by  holding  organizations 
accountable  for  the  ethical  behavior  of  thek  managers.  This  concern  is  not  limited  to  for-profit 
cirganizafions  but  has  also  focused  on  the  pttoiic  sector.  Honor  inddents  at  the  U.S.  Military 
Academy  and  the  U.S.  Air  force  Academy  resulted  in  both  organizations  instituting  several  new 
^biides  and  prograrrts  deaRng  with  honor  and  ethics.  So^ty  is  not  fedting  its  focus  to 
of^aniztfiions  but  is  atso  demanding  that  hs  public  figures  display  ethical  behavior  witnessed  by 
tite  withdrawal  from  candidacy  of  several  individuals  seeking  political  office.  Society  is 
ciamoHng  for  an  artswer  to  these  issues  &s  evtoenced  by  grants  and  endowments  to  universities 
to  address  tttis  area.  Thera  is  a  dichotomy  that  exists  within  society  in  response  to  these  Issues. 
On  the  one  hand,  society  seems  to  be  clamoring  for  ethics  to  be  taught,  and  yet  parents  are  not 
wiifing  to  tot  their  children  be  taught  ‘ethics''  in  the  schools.  By  the  time  a  person  reaches  the 
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without  any  formai  guidance  or  study. 


AniuiBily.  over  12,00  ettucs  courses  are  offered  by  undergraduate  business  schools 
(Murray,  1987).  The  purpose  of  these  classes  Is  to  force  students  to  think  through  all  the 
ramffications  of  an  issue  and  to  decide  for  themseiveB  what  is  right  and  what  is  wrong,  as  wen  as 
to  think  and  took  at  problems  in  new  ways  (Lee,1dBS;  Murray, 1987).  A  question  raised  by 
many  is  the  effecthreness  of  teaching  ethics  in  the  classroom.  Whie  Hoff  (1989)  suggests  that 
irufividuats  can  learn  to  make  ethical  decisions  and,  in  fact  change  their  ethics,  Lee  (1986) 
contends  that  while  eMca!  theories  and  cases  can  be  taught,  classes  canrtot  teach  someone  to  be 
ethicai  arid  this  method  is  doomed  to  tali. 

The  mltitafy  service  academies  are  perhaps  the  most  visible  organizations  to  make 
inroads  in  teaching  ethics  and  moral  behavior  in  an  educationai  environmenL  The  mast  obvious 
symbol  is  the  Impienwntaticn  of  an  honor  coda,  by  which  all  cadets  must  vow  to  abidd.  By 
having  an  honor  code,  the  service  acaderrles  are  abte  to  aeate  an  environment  where  honorable 
behavior  can  be  learned  and  reinforced.  True  honor  requires  active  support  of  positive 
prindptes  rather  than  simple  abstinence  from  wrongdoing.”  (Honor  Code  Reference  Handbook  of 
the  Air  Force  Cadet  Wing,  1967)  Raseardi  on  ethical  behavior  of  business  graduate  students 
supports  this  idea  of  reinforcement  Hagerty  &  Sims  (1987)  condude  that  the  threat  of 
punishment  may  have  a  restricting  Impact  on  unethical  behavior.  They  suggest  tfrat 
organizations  must  be  wiiiing  to  spedfy  poBdes  and  guidelines  for  maintaining  ethical 
behavior.  However,  they  caution  that  mereiy  developing  a  Code  of  Conduct  wii<  not  guarantee  Its 
practice.  If  there  are  no  sancticns  associated  with  unethical  behavior,  an  individuai  who  is 
personally  not  endowed  with  a  strong  value  system  will  most  Gkely  succumb  to  temptation. 

A  Convergence  Model  of  Ethical  Development 

How  does  one  get  an  indivkkial  or  an  organization  to  utilize  thek  hierarchy  of  values  to 
consider  the  long  term  consequences  of  its  actions  rather  than  immediate  gains?  Research  in 
value  systems  has  tended  to  be  seen  as  a  function  of  organizational  culture  which  is  in  turn 
related  to  organizaticnal  cUmate  and  effectiveness.  Where  does  an  individual  get  the  principles 
or  standards  that  they  reflect  on  in  determining  what  to  do?  Moral  behavior  has  been 
approached  from  either  the  moral  development  perspective  of  Lawrence  Kohiberg  (1976)  or  an 
espoused  values  perspective  such  as  Milton  RoKeach  (1973).  Recent  studies  (e.g..  Bridges  & 
PriesL  1983;  Priest,  1987;  and  Roffey,  Bryant,  &  Porter,  1988)  have  failed  to  support  a 
reiationshtp  tatween  advanced  stages  of  moral  development  and  predictability  of  desired 
behaviors.  There  is  little  empirica!  research  which  attempts  to  understand  value  systems  in 


erf  cifldsion  msMTHl  process.  Tte  yifluence  cf  an  hdividuars  values  on  ethicai 
^  addressed  bi  an  ej^^eiimem  oonduotad  lay  Ke^uty  &  Sl^ns  (19^}.  They  conduded 
^iolH^ren  #ti)  the  strongest  reinforeem^  for  unethical  behavior.  individuais  were 
^^pedeeSy*  ethicai.  Scholars  agree  that  an  Iradhriduai  appiot^iies  an  etiiical  dilemma  with  a 
pracoi^&oned  set  of  values  which  ctetirminas  thak  behavior. 


This  pretfminary  exanUnatioR  of  espoused  values  and  be.hsr^kui^J  outoomas  proposes  a 
new  technique  for  the  measureiner^  ethics  c^v^iopmenL  Four  populations  ate  compared 
according  to  a  revised  Rokaach  Value  Survey.  Samples  are  drawn  from  populations  of  business 
students  at  two  secular  urUversities.  a  sectarian  cottage,  and  e  military  academy.  Two  series  of 
propositions  are  set  forth.  The  &st  assod^es  sodaliy  undaskabte  or  deviant  behavior  with 
the  failure  to  discriminate  between  instrumentai  and  final  values.  Failure  to  dtecriminate 
results  from  deveiopmentai  lags  ki  sodateation  and  adaptive  re^)Mises  to  the  demands  of  Uie 
current  and  past  social  envIronmenL  The  second  set  of  propositlorrs  argi»  that  Individudiy 
d[$)djsed  values  are  a  better  predictor  of  ethical  behavior  frun  the  mechanics  of  fire  dadsion 
process  akme.  The  success  of  efforts  fo  instm  efoicai  behavior  in  individuats  is  best  measured 
by  convergence  ever  time  of  the  value  structures  of  the  individud  and  those  of  a  modd  group 
(e.g.,  faculty  and  mkiiary  training  staff)  whidt  exhibits  the  desked  behaviors.  Hypotheses 
tested  indude: 


HI :  Deviant  popuiatio.ns  wUI  tend  to  rank  the  Instnanentai  values  higher  than  find 
values. 


H2:  Non-deviant  populations  will  rank  the  find  values  higher  than  the  instrumentd 
values. 


H3:  Persons  educated  In  a  sectarian  arfo/or  liberal  arts  environment  win  rarJc  the  more 
abstract  termind  values  above  the  more  concrete  termind  vdues. 

H4:  Persons  educated  in  a  secular  and/or  mUitary  environment  will  rank  the  more 
concrete  termind  vdues  above  the  more  abstract 


HS:  Tliws  wilt  be  a  coitveisonce  over  time  ot  value  systems 

a:  within  tfte  student  oroi^. 

b:  within  the  model  group. 

o;  between  the  student  grot^  and  mcde!  group. 

d:  between  the  student  grot^t  and  the  model  group,  which  will  be 

acceiaratfid  at  dte  time  of  ini^  contact  and  during  times  of  crisis  and  exposure  to 
medals  highly  vatua  concentrated. 

Method 

TtM  sunrey  instrument  utHized  in  this  research  is  a  modification  of  the  Rokeach  Value 
Survey  (RV8)  (Rokaadt,t973)  which  Is  a  oomj^Miation  of  the  most  commonly  held  values. 
Customary  usage  of  the  RVS  lnv<dves  the  cre^n  of  two  s^arata  hierarchies  of  values,  one  tor 
the  terminal  values  and  ona  tor  tha  Irtstrumentai  vaiuas.  The  instrument  used  tor  this  study 
combines  the  elements  of  the  two  hierarchies  aiph^ticaHy  into  one  listing  oi  values  to  be 
placed  in  rank  order  by  the  re^ndents.  TNs  modified  instrument  raNts  values  both  within^ 
value-groito  end  betwaemvalue^oup.  Mean  rankings  are  then  examined  across  Uie  various 
sample  popidations.  This  instrument  achieves  a  rtiiability  coefficient  ot  .96.  Demographic 
information  regarding  age.  education,  ethnicity,  etc.  were  also  collected. 

implicatiORS 

Initial  analysis  of  the  results  leads  us  to  suggest  several  implications.  1}  While  ethical 
theory  classes  are  necessary  they  are  not  sufficient.  2)  Ethics  editoation  can  not  be  limited  to  a 
single  dose  method.  3)  Value  systems  of  tocuity,  staff,  and  the  institutton  itself  are  more 
powerful  a  teaching  tool  than  the  tradilional  classroom  approach.  4)  The  convergence  model 
has  bnpiicatlons  tor  the  predtotabitity  of  ethical  decisions  versus  prediction  of  deviant 
behavior.  The  linkages  established  by  this  preliminary  examination  of  expressed  value  systems 
and  behavioral  outcomes  win  have  far  reaching  implications  tor  the  indusion  of  value-based 
variables  into  the  decision  maklrtg  process  and  the  teaching  of  ethics  and  moral  behavior. 
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Abstract 


leadership  research  and  training  deals  vlth  quantifiable 
behaviors.  These  behaviors  aiay  be  appropriate  for  formal, 
static  situations,  but  inappropriate  for  fluid  situations.  An 
Internalized  four<dation  of  transcendental  beliefs,  not  measured 
by  quantifying,  may  provide  inner-strengtha  appropriate  to 
fluid  situations. 


Since  the  mid-l950's  most  of  the  leadership  research  has  been  of  three 
types,  with  some  minor  variations.  One  type  has  concentrated  on  quantita¬ 
tive  analysis,  trying  to  isolate  characteristics  of  leaders  so  as  to  in¬ 
crease  productivity  In  certain  tasks  and  identify  those  who  had  these 
characteristics.  This  kind  of  research  was  interested  in  identifying 
straightforward  leadership  behaviors  with  little  attention  paid  to  social 
dynamics.  Another  type  attempted  to  analyze  the  effects  of  group  dynamics 
on  leaders  and  the  reciprocal  relations  between  leaders  and  groups.  While 
q\taatlflcatlon  was  involved,  the  emphasis  was  on  soclo-psychological  fac¬ 
tors.  Attempts  were  also  made  to  develop  broad  theoretical  frameworks  and 
construct  ’’laws"  governing  groups  and  leaders.  Homans'  book. 

The  Human  Group,  is  an  example  of  this  kind  of  synthesis  in  theory  building 
and  Identification  of  "laws."  The  work  of  Cartwright,  Strodbeck  and  Katz  is 
typical  of  the  research  done  at  that  tine.  My  third  example  is  a  recent 
development  and  Includes  elements  of  both  the  soclo-psychological  and  the 
purely  quantitative.  It  Is  called  transformational  leadership,  the  concept 
based  on  research  which  attempts  tc  recognize  non-quantifiable  factors, 
those  elusive  factors  of  charisma  and  leadership  style.  The  watershed 
article  dealing  with  this  research  appeared  In  1971  in  Management  Science 
followed  by,  among  others,  books  such  as  Beyond  Rational  Management , 
Leadership  Challenge  and  Managing  Excellence. 


I  now  want  to  discuss  not  a  distinct  fourth  type  of  research  but 
whether  the  possibility  exists  that  there  may  be  overlooked  factors  which 
govern  leadership  behaviors  examined  in  the  former  three  types.  This  factor 
has  to  do  with  internalized  belief  systems  which  influence  leadership  on 
both  a  conscious  and  unconscious  level.  In  predictable  and  unpredictable 
situations.  The  factor  is  out  rtlatcu  wore  to  phlloscphy,  end  to  PlatorLio 
and  Heo-Platonic  philosophy  in  particular.  It  is  related  to  the  belief  In 
transcendentals  and  the  acceptance  of  transcendental  ideas  being  as  real  as 
what  we  can  quantify  or  observe. 


Unlike  the  former  types  of  research,  which  are  interested  primarily  in 


bdciiaviorB  And  productivity,  transcend  an  tals  are  not  anenable  to 
qu^tiflcartcn  and  not  concerned  with  productivity.  They  are  internalized 
■Ideas  vhlcfa  shape  behavior  for  other  than  mainly  productive  purposes  al¬ 
though  certain  kinds  of  productivity  result.  Transcendentala ,  r  would 
argue,  serve  to  strengthen*  emotionally  and  spiritually*  formal  leaders  in 
situations  of  chaos  and  danger  and  they  tend  to  lead  to  altruistic  behav¬ 
iors.  Txanscendentals  also  serve  to  create  new  leaders  as  the  new  leader 
dra^  from  the  Inner-strength  provided  by  the  transcendental. 

Ttanscendeatais  may  serve  as  the  determining  factor  in  maintaining  a  leaders 
strength  and  determination  when  normative  structures  collapse. 

Transcendeetals  are  often  ignored  In  research  and  in  academia  since 
they  do  not  fit  into  todays  reality,  being  considered  irrelevant  holdovers 
from  a  past  way  of  thinking;  superfluous  and  quaint. 

I  want  to  briefly  discuss  why  we  ignore  tranacendentals  and  In  so  doing 
provide  a  clearer  idea  of  what  I  mean  by  the  term.  At  the  end  of  the  13th 
century  a  debate  took  place  critical  to  determining  the  direction  of  Western 
thought,  Heo-pla tools ts  argued  a  reality  of  the  intellect.  Ideas,  or 
trtoscendeixtela,  such  as  Truth,  Beauty,  Self-Sacrifice,  Horor  and  Freedraa 
were  as  teal  as  what  we  can  see  or  measure.  Existing  on  a  higher  level 
these  tranacendentals  would  guide  our  actions,  providing  “purer"  behaviors 
which  would  reflect  the  transcendental  realities.  Opponents,  however,  lead 
by  William  of  Occum,  argued  that  reality  was  only  what  could  be  measured  and 
quantified.  Tranacendentals  were  superfluous  when  examining  real  life.  The 
nominalists  won  the  debate.  The  neo-Platonista  were  expelled  from  the 
universities.  Transceadentals  dlaappeared  from  the  curriculmn  as  an  element 
of  reality,  and  disappeared  as  a  part  of  the  mind  of  Western  man.  This  new 
mind  which  now  recognized  only  the  serjsza  as  real,  marched  towards  the 
triumph  of  science  in  ordering  the  senses  and  examining  situations.  Quanti¬ 
fication  was  governed  only  by  reality  as  reality  was  determined  by  man. 
Almost  all  aspects  of  our  being  became  quantifiable  as  being  and  becoming, 
morality  and  ethics,  were  defined  as  man  chose  to  define  them.  Consequent¬ 
ly,  our  research  in  leadership  ended  up  being  segmented  by  situations, 
particularistic  in  discussions,  cask  specific  in  applications, 
cognitive/pragmstlc  in  training,  and  primarily  self  examining  and  quantita¬ 
tive  in  design. 

Nov  Che  emphasis  on  quantification  In  identifying  leaders  Is  not 
without  its  strengths.  Such  an  approach  is  valiiable  in  identifying  "specif¬ 
ic"  leadership  characteristics  which  predict  "success"  within  a  variety  of 
job  situations,  provided  these  situations  are  static  in  outcome  and  are 
governed  by  accepted  norms.  The  quantitative  and  productive  research 
approach  also  assists  in  predicting  leadership  characteristics,  thereby, 
allowing  for  screening  and  enhancing  productivity.  So,  quantitative  and 
productive  research  Is  appropriate  for  predicting  traits  and  training 
leaders  for  situations  which  are  formal  In  structure  or  predictable  In 
sequence  and  task. 

But  this  approach  may  be  inappropriate  for  predicting  and  training  for 
leadership  when  situations  are  fluid  and  when  al]  familiar  and  recognizable 
norms  have  broken  down,  have  been  replaced,  or  are  reforming.  In  these 
situations,  I  would  argue,  transcendeetals  provide  strengths,  while  many  of 
the  quantitatively  or  productivity  assessed  measures  no  longer  are 


appropriate  to  the  situatlot:.  These  transcending  factors  lay  dormant  within 
an  Internalized  belief  structure.  But  at  certain  times  they  provide  a 
foundation  of  strength  and  meaning  from  which  a  person  acts. 

By  our  ignoring  a  '‘foundation  of  belief",  which  transcends  leadership 
defined  an  characteristics,  productivity  or  task  completion,  we  severely 
limit  th^  identification,  of  and  training  for,  leadership  by  "vision"  or 
through  ''inr.er  strengths. "  We  fail  to  recognize  and  train  for  leadership  in 
periods  of  long  term  deprivation  or  when  fot^.^1  and  predictable  situations 
no  longer  exist.  Tranacendentals  may  be  the  factor  which  explains  why  some 
people  rise  to  meet  moments  of  moral  truth  while  others  shrink  back. 

For  example,  could  anyone  have  predicted  the  leadership  which  surfaced 
anor;g  the  American  ecldlere  after  the  surrender  of  Batan  and  Corregldor? 
i'lany  from  the  ranks  who  never  shoved  leadership  capabilities  before,  and 
m-iny  in  peripheral  roles,  took  over  while  many  in  the  formal  roles  stood 
acxde.  Similar  situations  developed  amongst  prisoners  of  the  North 
Vlei:rAamese. 


:;'he  actions  of  the  new  leaders  were  selfless  and  altruistic,  self 
choeen  In  the  face  of  quantitative  evidence  of  danger  to  ones  self. 

And,  why  did  some  ordinary  citizens  in  a  small  French  town  risk  their 
lives  to  harbor  Jews?  And  why  did  they  assume  leadership  in  persuading 
their  neighbors  to  act  similarly? 


In  a  recent  book,  "The  Altruistic  Personality;  Rescuers  of  Jews  in 
Kazl  Europe,"  the  authors  present  a  £heory”o'f  Teaderahlp  which  bears  on  my 
discussion.  Controlling  for  many  factors  they  found  one  main  factor  which 
distinguished  rescuers  from  non-rescuers.  "What,  most  distinguished  (rescu¬ 
ers  T^ere)  embedded  relationships."  The  most  "embedded  relationship"  was  the 
family  and  a  family  with  deep  religious  commit»’ent  to  caring  about  others. 

A  Dutch  rescuer  said,  "It’s  not  because  1  have  an  altruistic  personality. 
It*s  because  I  em  an  obedient  Christian.  The  Lord  wanted  us  to  rescue  those 
people  and  we  did  It."  How  much  more  of  a  Transcendental  element  in  leader¬ 
ship  is  there?  And  more  importantly,  these  findings  seems  to  run  counter  to 
Adorno's  claims  that  religious  "types"  were  conservative  personalities, 
inflexible  and  tending  towards  far.  aism;  a  claim  incorporated  in  many  quanti¬ 
tative  Judgements  on  leadership  i=;entlal. 


I  think,  today,  even  William  of  Occum  would  raise  the  caution  that  our 
almost  totally  quantitative  minds,  geared  towards  productivity,  could  be 
overlooking  a  transcendental  factor  in  leadership.  We  might  even  be  misin¬ 
terpreting  some  data,  as  in  Adorno's  case,  by  concluding  that  those  with 
internalized  tranacendentals  are  inflexible  In  leaderehip  positions.  And, 
finally,  by  denying  the  existence  of  the  Platonic  reality  of  the  intellect 
ir.  favor  of  the  nominalist  reality  of  the  senses  alone,  might  we,  in  our 
training  of  the  young  (note,  I  did  not  say  education)  and  of  the  cadets,  be 
missing  a  ciifcital  racror  which  might,  in  other  situetlons;  sustain  and 
strengthen  them  for  a  trial  of  self  or  a  moment  of  moral  truth. 
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Abstract 

The  preisent  study  reports  field  validation  results  for  the 
Military  Equal  Opportunity  Climate  Survey  (MEXS).  A  preliailnary 
version  of  HEOCS  (Landis.  Fisher,  &  Dansby,  1988)  was  modified  and 
validated  using  a  sample  of  1650  military  personnel  representing  all 
military  Services  and  key  raclal/ethnlc/gender  groups.  Data  were 
gathered  at  six  sites  reflecting  geographic  and  mission 
heterogeneity.  Five  factors  were  identified  using  factor  analysis: 

Sexual  Uaraasaent,  Differential  Coimnand  Behaviors,  Positive  Equal 
Opportunity  (£0)  Behaviors,  Overt  Bacist/Sexist  Behaviors,  and 
■Reverse"  Dlsdrlmination.  Factor  reliabilities  ranged  from  .50  to 
.90.  Predicted  factor  score  differences  betwe  :,n  racial/ethnic/ 
gender  groups  ^ere  interpreted  as  validating  Pi:X)CS.  Additional 
comparisons  based  on  subsoales  from  other  insts'uments  included  in 
the  survey  package  (modified  Racial  Attitudes  and  Perceptions 
Survey;  Job  satisfaction  and  commitment  Itei^;  perceived  work  group 
effectiveness)  further  validated  MEOCS.  HEOCS  will  be  available  for 
coauaand  use  in  assessing  EO  climate. 

A  significant  amount  of  resoarch  has  been  conducted  on  organizational 
effeotiveness,  organizational  ollmate,  and  related  constructs.  However, 
relatively  little  research  has  been  directed  toward  equal  opportunity  (EO) 
climate  within  organizations.  Some  have  pointed  to  the  Impact  of  civil 
liberties  climate  on  organizational  outcomes  (Scheinfeld  A  Zalkind,  1987)  and 
the  effect  of  organizational  clLi^te  on  EO  and  affirmative  action  (Sargent, 
1978),  but  the  personal  and  organizational  influences  of  EO  climate  remain 
largely  unexplored. 

Landis,  Fisher,  and  Dansby  (1988)  reported  the  construction  and 
preliminary  validatior.  of  an  EO  climate  assessment  instrument  designed  for  use 
in  military  organizations.  This  instrument,  now  known  as  the  Military  Equal 
Opportunity  Climate  Survey  (MEOCS),  is  based  on  a  view  of  EO  climate  which 
emphasizes  expectations  by  individuals  within  an  organization  that 
opportunities,  responsibilities,  and  rewards  will  be  apportioned  based  on 
individual  merit  rather  than  race,  gender,  religious,  or  other  irrelevant 
factors.  Individual  perceptions  of  EO  climate,  whether  valid  or  not,  are 
perceived  as  influencing  responses  to  the  military  environment,  Job 
performance,  ccxamltment  to  the  military,  and,  ultimately,  unit  effectiveness 
(Landis,  Fisher,  &  Dansby,  1988). 

^This  paper  reflects  the  opinions  of  the  authors  only  and  should  not  be 
construed  as  official  policy  of  the  Department  of  Defense  or  any  organization. 


7iie  ispact  of  £0  climate  may  be  extensive  in  organisations.  At  the  very 
least,  an  "ataiosphere  of  discriEilnation"  serves  as  a  basis  for  legal  action 
(under  Title  VII  of  the  Civil  Eights  Act  of  1964)  by  individuals  against  the 
organization  (Baxter,  1985;  Laurent,  1987).  Bowers  (1975)  found  a  negative 
relationship  between  organizational  climate  and  felt  discrimination;  however, 
work  by  Parker  (1974)  and  Pecorella  (1975)  suggests  the  relationship  may  be 
keyed  to  interpersonal  interactions  within  particular  work  groups.  Grieseoer 
(1980)  found  significant  correlations  between  racial  climate  and  unit 
effectiveness. 

Other  researchers  have  (temonstrated  consistent  differences  between 
racial,  gender,  and  officer/enlisted  groups  in  perceptions  of  EO  and 
organizational  climate.  Brown,  Nordlle,  and  Thomas  (1977)  found  significant 
differences  between  whites  and  blacks  in  how  they  viewed  the  "race  problem"  In 
the  Army.  Spicher  (1980)  demonstrated  that  Air  Force  men  perceived  a 
significantly  more  favorable  organizational  climate  than  military  women; 
similarly,  officers  perceived  the  climate  more  favorably  than  enlisted 
members.  A  survey  conducted  by  the  Army  also  showed  differences  bett^en 
minorities  and  wnites  and  between  enlisted  members  and  officers  on  items 
dealing  with  EX)  (Soldiers  Report  IV.  1966). 

Reported  differences  in  perceptions  of  men  and  women,  minorities  and 
whites,  and  officers  and  enlisted  members  should  obtain  in  a  valid  measurement 
of  £0  climate.  The  purpose  of  the  present  study  was  to  further  develop  the 
factor  structure  of  HEOCS  and  to  validate  the  Instrviment  based  on  these 
predictions. 


Method 


Five  military  sites  were  initially  selected  for  the  validation  study, 
based  on  the  following  criteria;  all  military  Services  (including  the  Coast 
Guard)  must  be  represented;  each  site  must  have  representative  numbers  of 
female  and  minority  mwbers;  the  total  group  must  reflect  a  variety  of 
missions  and  geographic  locations;  one  site  must  be  overseas.  An  additional 
site  was  added  from  the  Air  Force  because  of  its  convenience,  wide 
representation  of  military  women,  and  suitability  for  testing  administration 
procedures.  The  sites  were  not  selected  to  be  representative  of  the  Services, 
but  to  provide  locations  where  a  wide  demographic  range  of  mllit£U‘y  personnel 
could  be  accessed  directly  in  cn-site  survey  administrations  and  interviews. 


Military  members  at  each  site  were  selected  according  to  a  purposive 
stratified  sample  reflecting  racial/ethnic,  gender,  and  officer  or  enlisted 
categories.  Among  the  1650  respondents.  Service  representation  ranged  frcjm  97 
(Coast  Guard)  to  607  (Air  Force).  All  major  combinations  (i.e.,  blaok/white, 
male/female,  and  officer/enlisted)  were  represented  by  at  least  200 
respondents,  with  the  exceptions  of  white  female  officers  (109),  black  female 
officers  (37),  and  black  male  officers  (80).  The  lower  incidence  of  these 
groups  was  due  to  their  sparse  representation  in  the  Se.  vioes  (white  women 
comprise  11.51  of  military  officers;  black  women,  1.5J;  and  black  men,  5. IS 


5C  iqaoT^ 


A  team  of  researchers  reflecting  raclal/ethnic  and  gender  diversity 
administered  the  157-*item  survey  on  site  in  a  group  setting.  Respondents 
rated  88  MEOCS  items  on  a  scale  of  1  to  5,  according  to  their  estimation  of 


listed  behaviora  (critical  incidents)  may  have  occurred  at 
i;:^eir  4u^y  during  the  last  30  days.  The  survey  package  also  included 

1^  items  measuring  ooamitment  to  the  Service,  5  Job  satisfaction  items,  6 
items ^assessing  perceived  work  group  effectiveness  (sources  for  these  iteo^ 
are  described  in  Landis,  Fisher,  &  Oansby,  1988),  27  items  adapted  from  the 
Racial  Attitudes  and  Perceptions  Survey  (RAPS;  Hist  et  el.,  1978),  several 
de^^api^c  items,  and  global  items  asking  uhether  the  respondents  perceived 
they  had  been  victims  of  discrimination.  After  each  administration  a  random 
sample  of  the  group  was  asked  to  remain  and  respond  to  a  structured  interview 
concerning  the  readability  of  the  survey  and  its  perceived  validity  fc«*  the 
stated  purpose.  Questionnaires  and  oomputcr-scoratxle  answer  sheets  were 
collected  by  the  researchers  after  each  administration. 


Results 


The  HEOCS  portion  of  the  questionnaire  was  factor  analyzed  using 
principal  component  analysis  with  varimax  rotation.  Five  primary  factors  were 
identified,  accounting  for  a  total  of  83.2]l  of  the  variance.  The  factors  are 
listed  in  Table  1,  along  with  their  psychometric  properties. 

Table  1 

MEOCS  Factor  Structure 


Factor  No. 

of  Items 

Eigenvalue 

%  of  Var. 

Alpha 

T 

M  t 

Sexual  Harassment 

21 

20.93 

58.0 

.93 

II. 

Differential  Command 
Behaviors 

11 

4.85 

13*0 

.90 

III. 

Positive  £0  Behaviors 

8 

1.85 

5.0 

.77 

IV. 

Overt  Bacist/Sexist 
Behavicrs 

6 

U54 

4.3 

.68 

V. 

"Reverse"  Diacrimination 

4 

1 .03 

2.9 

.50 

'Table  2  presents  a  summary  of  significant  factor  score  differences 
between  various  racial/ethnic,  gender,  and  personnel  category  groups. 


Commitment  to  the  Service  scores  were  higher  for  whites  than  blacks 
(£[1,16233  =  10.78»  £  <  .01);  for  males  than  females  (£[1,16233  *  5.01, 

£  <  .05);  and  for  officers  than  enlisted  members  (£[1,16233  »  20.92, 

f<  .0001).  Officers  scored  higher  than  enllstsd  members  on  Job  satisfaction 
£[1,16233  »  15.85,  £  <  -0001).  Whites  rated  their  work  groups  higher  in 
effectiveness  than  did  blacks  (£[1,16233  =  10.56,  £  <  .01);  officers  rated 
work  group  effectiveness  higher  than  enlisted  members  did  (£[1,16233  =  22.88, 
£  <  .0001). 


On  the  RAPS  portion,  blacks  perceived  more  discrimination  against 
minorities  than  did  whites  (£[1,16233  =  369.99,  £  <  .0001);  women  more  than 
men  (£[1,16233  =  56.26,  £  <  .0001);  and  black  officers  than  black  enlisted, 
while  ths  rs'/crcc  was  trus  for  whites  (£[1.1623]  ?  1 2^  An.  <  ^O?) .  On  the 
RAPS  "Reverse**  Discrimination  factor,  males  perceived  greater  occurrence  than 
did  females  (£[1,1623]  =  10.90,  £  <  .001);  whites  perceived  more  than  blacks 
(££1,16233  «  "45.65,  £  <  .0001);  and  black  officers  perceived  more  than  black 
enlisted,  while  the  reverse  was  true  for  whites  (£[1,1623]  =  8.99,  £  <  .01). 


third  RilPS  factor,  aales  agreed  asore  than  females  that  the  races  should 
'  separate  (JF£1,1623]  r  10.99,  £  <  .001),  and  blacks  agreed  more  than 

*4y^t63  that  the  ra^es  should  be  separated  (£[1,1623]  s  10.20,  £  <  .01). 

Table  2 

Significant  HEQCS  Factor  Score  Differences 


Factor  Significant  Differences 


I  Women  perceived  sore  sexual  harassment  behaviors  occur  than 

did  men  (£[1,1623]  =  39.62,  £  <  .0001);  blacks  perceived 
greater  occurrence  than  whites  (£[1,1623]  =  28.39, 

£  <  .0001);  black  officers  perceTved  greater  occurrence 
than  black  enlisted,  but  white  enll.^ted  perceived  greater 
occurrence  than  white  officers  (£[1,1623]  =  8.19,  £  <  .01). 

11  Women  perceived  greater  occurrence  of  differential  command 

SO  behaviors  than  did  men  (£[1,1623]  =  21.54,  £  <  .0001); 
blacks  perceived  greater  occurrence  then  whites  (£[1,1623] 

=  241.78,  £  <  .0001);  black  officers  perceived  grater 
occurrence  than  black  enlisted,  but  white  enlisted 
perceived  greater  occurrence  than  white  officers  (£[1,16233 
=  5.39,  £  <  .05). 

Ill  Whites  perceived  greater  occurrence  of  positive  EO  behaviors 

than  did  blacks  (£[1,16233  =  72.37,  £  <  .0001); 
officers  perceive?  greater  occurrence  than  enlisted 
(£[1,1623]  =  21.11,  £  <  ,0001). 

IV  Blacks  perceived  greater  occurrence  of  racist/sexist  behaviors 

than  did  whites  (£[1,1623]  =  13.81,  £  <  .001);  white 
enlisted  perceive?  greater  occurrence  than  officers 
(£[1,1623]  »  5.17,  £  <  .05). 

V  Males  perceived  greater  occurrence  of  “reverse*' 

discrimination  behaviors  than  did  fooales  (£[1,1623] 

=  6.45,  £  <  .01). 


Discussion 

The  results  are  interpreted  to  support  the  use  of  MEOCS  as  a  measure  cf 
£0  climate.  The  psychometric  properties  az>e  generally  considered  acceptable; 
however,  additional  items  will  be  generated  in  an  attempt  to  improve  the 
reliability  of  Factor  V,  "Reverse"  Discrimination,  because  of  the  relatively 
low  alpha  value  ( . 50} .  The  general  pattern  of  results  shows  the  predicted 
agreement  between  MEOCS  and  other  instruments.  As  predicted,  there  were 
significant  differences  in  how  males  and  females,  minorities  and  whites,  and 
officers  and  enlisted  members  viewed  discriminatory  behaviors.  Comparisons 
between  RAPS  reiults  and  MEOCS  results  also  support  the  construct  validity  of 
MEOCS. 


The  MEOCS  is  undergoing  final  revisions  to  reduce  the  number  of  items  and 
iupppova  the  reliability  of  Factor  V.  The  survey  will  be  available  for 
administration  within  military  commands  on  a  by-request  basis.  Plans  are 
being  developed  for  administering  MEOCS  to  a  normative  probability  sample  from 
each  Service.  Finally,  MEOCS  is  being  used  to  assess  the  impact  of  £0  climate 
on  missicxi  effectiveness,  as  indicated  in  Landis,  Fisher,  k  Dansby  (1988). 
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Major  Hayoa  E.  Dilllogbaa^ 
Aaalata&t  Profeaaor  of  Lav 
Uoitad  Stataa  Air  Forca  Acades^ 


Aba trace 


Sagardiog  wm  in  caabat»  the  *^0  Risk  Aula**  la  ao  official 
Oapactaeat  of  Defetiae  policy  ptoamuLceae&t  which  atatea  that  the 
dak  of  capture  la  a»oag  the  proper  criteria  for  cloalog  certaia 
poeltlopa  or  ttolta  to  voaeu.  Many  argue  that  thla  rlak  la  a  proper 
conelderatloa  becauae*  they  believe,  American  ailltary  voaea  aerving 
aa  prlaoners  of  var  would  have  aubetantlal  adverae  couaequeocea  for 
national  aeeuclty.  Such  argUMnCa  are  baaed  on  apeculation. 
Bowever,  behavioral  acleatlata  coold— and  ahould’~<conduet  reaearch 
to  reduce  the  level  of  apeculation  Involved.  Theae  atadlea  would 
eaaiat  in  cither  eupportlag  or  re'ating  euch  argoaesta  and,  In  ac 
doing,  would  provide  an  invaluable  aervice  to  otir  nation'a 
poXlcyeakera. 

Eventa  eaaocleted  with  the  United  Statea'*  recent  Invaalon  of  Peneaa 
deaonetrete  thet,  In  our  future  eiraed  eonflicta,  there  la  an  ever  increaelng 
likelihood  that  Aaerlcan  ailltary  woven  will  be  directly  mgaged  In 
front-line  coebet  operations.  Hevertheleea,  there  reaeina  e  body  of  federal 
law  and,  aorc  leportantly,  policy  which  purporta  to  ellalnatc  or  at  least 
reduce  the  rlak  thet  theae  woaan  will  be  ezpoaed  to  direct  coabet,  hostile 
fire,  or  capture.  However,  neither  the  lav  ixor  policy  la  chiseled  in  atone. 
Aaerlca'a  poUcyaakere  are  free  to  change  thea  sC  any  tlee.  In  fact,  aany  in 
Congress  and  throughout  our  federal  govemaent  are  now  taking  a  fresh  look  at 
the  laeue  of  woBen  In  coahet.  Behaviorel  aclectlsts  ere  in  an  Ideal  position 
to  provide  thea  eealstence— eapccielly  ea  these  pollcyaakera  consider  the 
poselbllity  that  Aaerlcan  ailltary  woaen  aay  be  captured  and  becoac  prisoners 
of  war. 


*The  views  expressed  herein  are  solely  those  of  the  author  and  do  not 
acceasarlly  reflect  tboee  of  either  the  United  States  Air  Force  Acadeay,  the 
United  States  Air  Force,  or  the  Departaent  of  Defense. 


The  Current  Policy 


71m  Defense  Depertsent's  current  policy  regarding  women  In  combat  is  set 
forth  in  the  so**calle<!  “OoD  &isk  Rule.”  It  is  an  official  policy 
pronouncement  vhicht  in  effect »  is  couched  in  terms  of  a  balancing  test  based 
<m  the  type,  degree,  and  duration  of  certain  rlsks-*one  of  which  is  the  risk 
of  capture. 

Is  the  risk  of  capture  a  valid  consideration  in  this  regard?  Is  it 
properly  smong  the  criteria  to  be  considered  in  closing  certain  positions  or 
units  to  women?  Or,  should  we  remove  risk  of  capture  from  the  Bisk  Buie's 
balancing  test?  In  ao  doing,  are  we  Americans  prepared  to  say  that  we  are  no 
more  concerned  about  our  military  vamtn  becoming  prisoners  of  war  than  we  are 
our  military  ann? 

From  on  ethical  perspective,  I  believe  that  we  should  treat  our  military 
women  with  dlgnlty~*as  rational  human  beings  with  a  free  will,  informed  by 
teosoxu  If  these  women  choose  to  expose  themselves  to  the  risk  of  capture 
and  to  the  poaslblllty  of  cruel  and  inhuman  treatment  or  even  death,  then  we 
should  not  deny  thorn  that  freedom  of  choice. 

Many,  on  the  other  hand,  advocate  a  utilitarian  approach.  They  contend 
that  American  mllltazy  women  serving  os  prisoners  of  war  would  result  in 
substantial  adverse  consequences  for  our  national  security.  However,  they 
cannot  demonstrate  that  aoch  adverse  consequences  would  actually  result* 
Their  arguments  ere  based  on  speculation.  For  all  they  know,  women  in  the 
prisoner  of  war  environment  may  even  have  beneficial  effects.  Such  is  the 
nature  of  spcculatloa.  The  results  could  go  either  way. 

B^iavloral  scientists  could  help  in  resolving  many  of  these  issues.  They 
ore  ideally  suited  to  conduct  the  necessary  research  and  provide  the  proper 
analyses  so  os  to  reouce  the  level  of  speculation  involved.  Such  studies 
would  assist  in  either  supporting  or  refuting  the  above  arguments. 
FurthenK>re,  through  these  studies,  behavioral  scientists  would  provide  an 
invaluable  service  to  our  nation's  policymakers  regarding  one  aspect  of  this 
complex,  controversial  issue  we  call  “women  in  combat," 


The  Challenge 


No  amount  of  reaearch  or  study  can  resolve  all  of  these  issues  or  remove 
ell  of  the  speculatiou  regarding  the  consequences  of  American  military  women 
os  prisoners  of  war.  Only  the  experience  of  American  combatant  wemen  in 
actual  captivity  could  answer  all  of  the  questions.  However,  behavioral 
science  research  could  provide  substantial  insight  and  assistance  os  we 
attempt  to  predict  those  consequences .  Moreover,  because  our  policymakers 
are  reevaluating  our  position,  ve  need  the  research  now.  After  all,  we  do 
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If  Anerlcaa  mlUtai?  woiuq  should  ever  becoate  prisoners  of  war  la  any 
future  conflict^  It  will  not  be  a  historical  first.  During  World  War  II,  for 
exaaple,  eleven  Wavy  nurses  and  sixty-six  Any  nurses  vere  captured  by  the 
Japanese  in  the  Philippines  and  held  prisoner  for  thirty-seven  months. 
Although  the  experience  of  these  woaen  is  important  for  our  analysis,  we 
should  not  draw  any  final  conclusions  from  it.  Modern  captors,  in  their 
interrogation  and  exploits. v ion  attempts,  generally  subject  their  prisoners  to 
treatment  that  is  substantially  more  cruel  and  inhuman  than  that  experienced 
by  World  War  II  prisoners.  Furthermore,  female  combatants  who,  for  example, 
may  have  just  bombed  an  enemy's  country  arc  not  likely  to  be  viewed  in  quite 
the  same  manner — nor  receive  the  same  treatsieat — aa  the  female  nurses  whom 
the  enemy  Just  captured  in  a  field  hospital. 

For  the  sake  of  analysis,  ve  should  begin  by  assuming  that  American  voaien 
who  bec<ne  prisoners  of  war  in  future  conflicts  will  be  subjected  to  the  most 
extreme  physical  and  psychological  torture  imaginable  as  the  enemy  attempts 
to  interrogate  and  exploit  them.  We  should  also  assume  that  the  enemy's 
techniques  regarding  women  will  include  rape,  threats  of  rape,  sexual 
assault,  and  other  forms  of  sexual  misconduct.  Given  this  framework  for 
analysis,  behavioral  scientists  should  begin  their  research. 

In  this  framework,  the  question  of  pregnancy  almost  invariably  arises. 
Therefore,  for  the  sake  of  a  complete  discussion,  it  should  be  addressed. 
However,  from  a  medical  perspective,  it  must  be  emphasized  that  such 
pregnancies  are  most  unlikely.  Given  the  extreme  stress  axid  poor  diet 
generally  associated  with  the  prisoner  of  war  environment,  most  if  not  all  of 
these  women  will  likely  e:q>crieuce  amenorrhea  (absence  of  the  menses)  and, 
therefore,  the  likelihood  of  pregnancies  will  be  decreased. 

Amenorrhea  is  a  symptom  which  may  result  from  any  one  of  several 
causes— one  of  which  ia  hypotltalamlc  dysfunction.  Although  h3rpothalamic 
amenorrhea  is  not  yet  folly  onderstood.  It  is  frequently  diagnosed  among 
women  who  are  "serious  athletes,  ballet  dancers,  voi^n  under  severe  stress, 
and  those  with  sudden,  large  losses  of  body  fat”  (Burke  A  Lin,  1988). 
Amenorrhea  is  also  reported  to  be  common  among  new  female  cadets  at  the 
service  academies.  In  fact,  the  Nurse  Practitioner  in  the  Air  Force 
Academy's  Cadet  Clinic  Primary  Care  has  informed  me  that  roughly  80  percent 
of  the  female  cadets  who  enter  the  Academy  as  freshmeu  do  not  experience  a 
menstrual  period  from  the  time  of  arrival  In  the  aommer  until  returning  to 
their  respective  homes  for  the  Christmas  holidays  (Guzman,  1989).  In  light 
of  all  of  the  above  observations  and  experiences,  we  can  expect  that,  if  any 
American  women  do  experience  pregnancy  during  captivity,  it  will  probably  be 
because  they  coucelved  before  capture  or  were  raped  shortly  after  capture. 
The  chance  that  they  could  become  pregnant  at  any  subsequent  time  is 
substantially  reduced — even  if  the  captivity  should  extend  for  a  period  of 
years. 


I 
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Even  if  pregnancy  la  only  a  reoote  poaslblUty,  we  imst  still  consider 
that  possihllity.  It,  then,  raises  numerous  questions  for  behavioral 
scientists.  For  example,  how  %rell  would  the  women  be  treated  during 
pregnancy?  What  are  the  chances  of  miscarriage?  What  effect  would  such  a 
miscarriage  have  on  the  prisoner  of  war?  Should  the  United  States  have  an 
official  policy  position  concerning  women  who  desire  abortions  under  such 
circumstances?  Would  such  abortions  create  dissension  among  fellow  prisoners 
of  war?  Would  these  abortions  be  performed  by  enemy  personnel?  By  fellow 
prisoners?  Or,  would  they  have  to  be  self ^induced?  If  we  expect  American 
military  women  to  become  prisoners  of  war  someday,  then  we  should  begin 
addressing  these  questions  today. 


There  are  numerous  other  questions  which  behavioral  scientists  should 
likewise  address.  At  the  very  least,  they  should  ask:  Bow  would  American 
military  women  perform  in  captivity?  Are  there  physical  or  psychological 
differences  which  would  prevent  ttusm  from  perforoing  as  well  as  their  male 
counterparts?  Xf  so,  are  there  likely  to  be  any  adverse  consequences  for 
nstlcnal  security?  Or,  on  the  other  hand,  are  the  women  likely  to  perform 
better  chan  their  male  counterparts?  Furthermore,  what  would  be  the  likely 
effects  of  Axurican  military  women  being  present  in  the  prisoner  of  war 
environment?  Would  their  presence  have  a  detrimental  or  a  beneficial  effect 
on  Che  male  prisoners?  What  types  of  relationships  would  likely  fora  and  what 
would  be  Che  effects  of  these  relationships?  Would  male  prisoners  have  a 
tendency  to  be  overly  protective?  What  new  leadership  challenges  would  the 
presence  of  women  prc8eat~both  in  the  prisoner  compound  and  on  the  home 
front?  What  would  be  the  effect  on  public  support  for  the  war— i.e.,  the 
national  wlll'-nrhen  the  American  public  realizes  that  our  military  women  are 
being  held  captive?  Would  we  as  a  society  be  capable  of  accepting  that  our 
women  are  being  physically  and  mentally  tortured  and  abused  in  the  cruelest 
and  most  inhuman  ways?  Could  vc  cope  with  chat  fact?  Again,  what  would  be 
the  likely  consequences  for  national  security? 


Although  it  would  by  no  means  dispose  of  any  of  these  issues,  X  suggest 
chat  behavioral  scientists  at  least  begin  their  research  by  observing  the 
Code  of  Conduct  training  in  our  services'  level-C  SEEE  [Survival,  Evasion, 
Resistance,  and  Escape]  Training  Programs.  These  high-stress  training 
programs  include  simulated  captivity  in  mock  prisoner  of  war  compounds  and 
offer  excellent  opportuoicies  for  observation,  data  collection,  and  analysis. 
It  would,  of  ':ourse,  be  a  mistake  to  conclude  chat  the  performance  of  women 
in  a  crainini  environment  necessarily  lodlcates  how  they  would  perform  in 
actual  captlv.  However,  it  should  provide  at  least  some  insight — *and  it 
is  a  source  of  relevan'^  ioformatlon  that,  as  of  now,  is  being  overlooked. 
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The  United  States  Air  Force  level-*C  SSSE  Training  Prograa  located  at  the 
Air  Force  Academy  provides  one  example  in  this  regard.  Each  8aoBaer»  the  Air 
Force  conducts  three  3-veek  periods  of  such  Code  of  Conduct  training  at  the 
Academy.  Although  no  detailed  records  of  student  performance  are  retained 
after  each  suaiier,  my  personal  observations  as  one  of  the  Officers-in-Charge 
of  the  Resistance  Training  Lab  (l.e.,  prisoner  of  war  compound)  ond  my 
discussions  with  members  of  the  permanent  SERE  staff  Indicate  that  the  female 
students  axe  generally  outstanding  performers  and  are  very  adept  at 
resistance  techniques '■‘‘perhaps  even  better  than  their  male  counterparts. 
More  specifically »  during  the  three  SERE  training  periods  of  1989,  female 
studiints  distinguished  themselves  by  winning  the  following  performance 
awards:  (1)  during  Ist  period,  one  "Best  Student  in  Squadron"  award — a 
squadron  consisting  of  100-120  male  and  female  students,  (2)  during  2ad 
period,  one  "Best  Student  in  Squadron"  award,  and  (3)  during  3rd  period,  two 
"Best  Student  in  Squadron"  awards,  one  of  whom  went  on  to  win  the  "Best 
Overall  Student*'  award— in  other  words,  the  best  among  450-480  sale  and 
female  students.  Looking  back  over  the  experience  of  recent  years,  the  SERE 
staff  confirm  that  these  1989  awards  are  representative  of  the  numbers  and 
types  of  awards  presented  to  their  female  students  in  previous  years. 
Nevertheless,  there  have  been  no  records  kept,  no  studies  performed,  no 
analyses  made,  nor  any  such  recoaBsendatlons  offered  as  to  how  ve  could 
Icprove  this  aspect  of  our  training. 


Conclusion 

It  Is  likely  that  the  mere  passage  of  time— and  the  continued  social 
advances  one  can  expect  to  accompany  it — will  resolve  many  of  the  current 
issues  related  to  women  In  combat.  As  Americans''  views  toward  traditional 
male  and  female  roles  continue  to  change,  our  society's  views  toward  women  in 
combat  will  probably  change  as  well.  In  the  awantime,  however,  behavioral 
sclenclsts  should  conduct  detailed  studies  regarding  the  likely  consequences 
of  women  serving  in  every  aspect  of  combat— including  the  prisoner  of  war 
environment.  Through  such  studies  of  women  as  prisoners  of  war,  behavioral 
scientists  would  provide  an  invaluable  service  to  our  nation's  policymakers 
as  they  consider  this  one  very  Important  aspect  of  women  in  combat. 
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Abstract 

The  present  study  examined  person-  and  situation>level 
predictors  oT  equal  opportunity  citizenship  behaviors  (EOCBs)  and 
training  performance  grade-point  average  of  96  students  in  the  16- 
week  resident  equal  opportunity  course  of  the  Defense  Equal 
Opportunity  Management  Institute.  Patrick  Air  Force  Base.  Florida. 

Data  indicated  that  personal  views  about  equal  opportunity  and 
dispositional  positive  affect  accounted  for  variance  in  EOCBs,  while 
equity  p^ceptlons  accounted  for  variance  in  training  perfoimance. 

Organizaticws  rely  an  their  perscamel  to  help  co-workers  with  problems, 
tolerate  Inconvezilences  without  complaint,  promote  a  positive  work  climate, 
and  protect  organizational  resources.  These  "prosocial  organizational 
behaviors'*  (Brief  A  Motowidlo,  1986)  or  "organizational  citizenship  behaviors" 
(OC^;  Organ,  1985)  are  discretionary  and  aimed  at  improving  the  welfare  of 
oo-workers,  tbs  work  group,  or  the  organization.  While  they  are  neither 
prescribed  nor  required  in  advance  for  a  ^b,  they  may  have  a  significant 
imipact  on  organizational  effectiveness. 


Research  on  OCBs  has  focused  on  behaviors  of  traditional  interest  to 
private  sector  managers  and  ignored  socially  responsible  behaviors  of 
considerable  Interest  to  the  Department  of  Defense  (DoD),  namely  behaviors 
that  enhance  equal  opportunity  (EO)  and  equitable  treatment  of  individuals. 

At  the  Defense  Equal  Opportunity  Management  Institute  (DEOHI),  military 
per3(»rmel  are  trained  to  serve  as  £0  advisors,  and  part  of  that  training 
involves  EO  citizenship  behaviors  (S^CBs).  Given  the  importance  of  this  type 
of  socially  responsible  behavior,  a  theoretical  and  practical  Issue  becomes 
the  identification  of  factors  that  give  rise  to  or  inhibit  these  behaviors  in 
the  military  settii^.  In  other  words,  tdiat  factors  motivate  a  person  to 
manifest  EOCBs?  In  line  witn  Brief  and  Motowldlo's  (1986)  call  for  the 
identification  of  the  individual-level  correlates  of  prosocial  organizational 
behavior  and  with  the  DoD's  concern  with  EO  behaviors,  the  present  study 
examines  both  situation-  and  person-level  predictors  of  EOCBs  and  £0  trairiing 
performance.  Variables  Inolude  perceptions  of  the  SO  climate,  perceptions  of 
equity,  situational  affect  (i.e.,  job  satisfaction),  dispositional  affect,  and 
personal  views  about  EO. 


Both  practitioners  and  researchers  have  recognized  the  impact  of 
organizational  climate  on  £0  and  affirmative  action  (e.g.,  Sargent,  1978).  In 
line  with  Schelnfeld  and  Zalkind's  (1967)  work  demonstrating  the  impact  of 


^This  paper  reflects  the  opinions  of  the  authors  only  and  should  not  be 
construed  as  official  policy  of  the  Department  of  Defense  or  any  organization. 


civil  liberties  clioate  on  organizatiotiai  outcomes,  Landis  and  Fisber  (1987) 
argved  that  individual  perceptions  of  an  organization's  "equal  opportunity 
cllajate"  have  a  direct  impact  on  mission  effectiveness  in  military 
organizations.  They  (1987,  p.  8)  defined  EO  climate  as  t-he  expectation  of 
organization  members  "that  they  will  have  equal  access  to  opportunities, 
responsibilities,  and  rewards  within  an  organization."  Individuals  perceiving 
greater  EO  at  their  duty  stations  (i.e.,  having  a  more  favorable  psychological 
climate  for  £0)  should  perceive  EO  as  a  norm.  Thus,  «e  predicted  they  would 
engage  in  greater  levels  of  EOCBs  and  work  harder  to  clo  well  in  £0  training. 


Procedural  Justice  research  on  organ! 2:ational  rewards  has  provided 
evidence  of  the  importance  of  resource  distribution  procedures  as  determinants 
of  fadrness  in  organizations.  For  example,  Landy,  Barnes-Farrell ,  and 
Cleveland  (1980)  found  that  the  process  by  which  workers’  performance 
appraisals  were  determined  was  related  to  the  perceived  fairness  of  uh.^ir 
evaluation,  independent  of  outcome.  Similarly,  Greenberg  (1987)  reported  that 
laboratory-manipulated  fairness  of  procedures  influenced  perceptions  of  the 
fairness  of  outcomes.  In  line  with  the  literature  suggesting  an  exchange 
basis  for  responses  to  equity/ inequity,  we  predicted  that  individuals 
perceiving  equity  (i.e.,  those  who  perceive  they  have  been  treated  fairly) 
with  regard  to  outcomes  such  as  duty  assignments,  fitness  reports,  and  overall 
treatment  would  engage  in  greater  levels  of  EOCBs  and  work  harder  in  EO  class. 


Considerable  evidence  suggests  that  mood  is  a  strong  predictor  of 
prosocial  behavior  (Rushton,  198^).  Organ  (1988,  p.  3^)  argued,  "If  we  .  .  . 
assume  that  Job  satisracticn  translates  into  a  predominant  mood  state  .  .  .  , 
then  it  follows  .  .  .  that  Job  satisfaction  scores  should  bear  a  positive 
correlation  to  a  valid  index  of  OCB."  Congruent  with  the  assumption  that  Job 
satisfaction  reflects  dispositional  affect,  researchers  have  used  Job 
satisfaction  as  a  surrogate  for  dispositional  affect  In  studies  examining  the 
relationship  between  affect  and  OCBs.  Organ  has  suggested  that  Individuals 
seek  to  reciprocate  the  organlzaticn  to  the  extent  that  the  organization 
benefits  them  (i.e.,  to  the  extent  that  they  are  satisfied  with  the 
organization).  Therefore,  the  more  satisfied  the  individual  is,  the  more 
likely  the  individual  will  "pay  back"  the  organization  with  OCBs.  Organ  has 
noted  that,  while  an  individual  may  not  have  the  ability  to  provide  innovative 
solutions  to  work  problems,  he  or  she  may  have  the  capacity  to  manifest  good 
citizenship  behaviors.  He  (1988,  p.  ^3)  cited  eight  studies  in  support  of  his 
argument  and  suggested  that,  “they  lend  reasonable  support;  to  the  hypothesis 
that  OCB  and  job  satisfaction  are  bound  together."  The  emerging  OCB 
literature  suggests  that  Job  satisfaction  may  have  a  direct  bearing  on  the 
extra-role  aspects  of  Job  performance.  Following  this  literatujre,  we 
predicted  that  personnel  more  satisfied  with  their  Jobs  would  be  more  likely 
to  engage  In  greater  levels  of  EOCBs  and  work  harder  in  the  EO  course. 

Staw,  Bell,  and  Clausen  (1936,  p.  61)  argued  that  employees  "bring  a 
positive  or  negative  aispositicn  to  the  work  setting,  process  inforaation 
about  the  Job  in  a  way  that  is  consistent  with  that  disposition,  and  then 
experience  job  satisfaction  or  dissatisfaction  as  a  result."  They  asserted 
(p.  61)  that  the  development  of  Job  attituaes  "comeLsj  as  much  from  tne 
internal  state  of  the  individual  as  from  einy  external  cues.*'  In  line  with 
their  argu^nt,  is  it  context-relevant  Job  satisfaction  or  dispositional 
affect  that  is  related  to  OCBs?  la  the  studies  cited  by  Organ  (1938),  affect 
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was  operaticnalizefl  as  Job  satisfaction,  although  research  has  shovm  that  Job- 
related  stressors  accounted  for  about  of  the  variance  in  OCBs. 

In  studies  of  self-reported  mood,  negative  and  positive  affect 
consistently  have  been  identified  as  the  two  relatively  independent  and 
dominant  dimensions  (Watson  &  Tellegen,  ^965),  Watson,  Clark,  and  Tellegen 
(t988,  p.  1063)  defined  them: 

Positive  Affect  (PA)  reflects  the  extent  to  which  a  person  feels 
enthusiastic,  active,  and  alert.  High  PA  is  a  state  of  high  energy, 
full  concentration,  and  pleasurable  engagement,  whereas  low  PA  is 
characterized  by  sadness  and  lethargy.  In  contrast,  Negative  Affect 
(NA)  is  a  general  dlmenslo?^  of  subjective  distress  and  unpleasurable 
engagement  that  subsumes  a  variety  cf  aversive  mood  states,  including 
anger,  contempt,  disgust,  guilt,  fear,  and  nervousness,  with  low  NA 
being  a  state  of  calmness  and  serenity. 

This  independence  means  that  High  and  Low  PA  can  have  different  patterns 
of  relationships  with  other  variables,  as  noted  by  Brief  and  Motowldlo 
(1986),  this  helps  to  explain  some  of  the  inconsistent  findings  in  the 
altruism  literature.  While  data  suggest  that  positive  moods  generally  promote 
helping  behavior  (Rushton,  198iJ),  negative  moods  have  been  found  to  both 
increase  and  decrease  it  (Clark  A  Isen,  1982).  Recent  advances  in  affect 
theory  and  methodology  permit  assessment  of  both  positive  and  negative  affect 
in  organizational  settings.  In  line  with  this  body  of  research,  we  predicted 
that  individuals  experiencing  greater  positive  affect  and  Job  satisfaction  and 
lower  negative  affect  would  engage  in  greater  levels  of  EOCBs  and  work  harder 
to  learn  means  to  communicate  EO  concerns  to  others. 

We  were  also  interested  in  individuals'  personal  views  about  EO.  We 
predicted  that  individuals  who  held  views  more  supportive  of  EO  in  the 
military  would  be  more  likely  to  engage  in  greater  levels  of  EOCBs  and  work 
harder  to  learn  means  to  communioate  EO  concerns  to  others. 

M(  thod 

Ninety-six  volunteers  from  the  122  students  in  Class  89-3  of  the  resident 
£0  training  course  at  DEOHI  anonymously  completed  a  questionnaire  in  response 
to  a  request.  Predominantly,  participants  were  male  U.S.  Aray  enlisted 
members  in  the  grade  of  sergeant  first  class  (E-7).  For  the  most  part,  the 
students  were  not  volunteers  for  EQ  duty.  Equal  Opportunity  Citizenship 
Behaviors  were  assessed  by  seven  items  (X  =  2?.^,  ^  =  A. 5,  alpha  =  .66). 
Training  performance  grade-point  average  was  assessed  by  one  question,  in 
which  studenca  were  asked  to  Indicate  their  overall  grade-point  average. 
Psychological  climate  for  EO  was  measured  by  the  13  items  loading  highest  on 
the  Landis  and  Fisher  (1987)  EO  climate  measure  (T  s  ^  i  13.2, 

alpha  =  .93)*  Perceptions  of  fairness  of  fitness  reports,  duty  assignments, 
Job  tasks  assignment,  and  overall  treatment  In  the  military  (l.e.,  equity 
perceptions)  were  assessed  by  12  items  ^  -  61.6,  SO  c  6.5;  alpha  =  .91 )• 

Eight  items  measured  Job  satisfaction  (,x  =  32.1,  ^  =  c.6,  alpha  =  .65) 
Positive  affect  and  negative  affect  were  measured  by  the  Watson  et  al.  (1986) 
lO-item  Positive  Affect  Scale  {J  =  38.6,  ^  =  ^.6,  alpha  =  .65)  and  10-item 
Negative  Affect  Scale  (7  =  20.5,  ^  =  6.8,  alpha  =  .9^).  respectively. 

Personal  beliefs  about  EO  were  measured  by  one  item  in  which  students  were 


asked  to  indicate  tile  extent  to  wnich  they  held  beliefs  supporting  EO  efforts 
in  Che  Dilitary  (J  -  ^.3,  SD  =  .86). 


Results 

The  correlations  between  EOCBs  and  the  variables  of  interest  were  as 
follows;  perceptions  of  EO  clitate,  £  2  ~.10,  perceptions  of  equity,  £  ^ 
-.15,  ns;  Job  aatlsfactlon,  £  =  .20,  _£  <  .03;  dispositional  positive  affect,  r 
»  .39,  _£  <  .01;  dispositional  negative  affect,  r  =  -.22,  £  <  .02;  personal 
beliefs  about  EO,  £  =  .^1,  £  <  .01;  and  training  performance  grade-point 
average,  £  =  -.1Q,~ns. 

The  correlations  between  training  performance  grade-point  average  and  the 
variables  of  interest  were  as  follows;  perceptions  of  EO  climate,  £  s  -.11, 
ns;  perceptions  of  equity,  £  =  -.42,  £  <  .01;  Job  satisfaction,  £  =”".02,  ns; 
dispositional  positive  affect,  £  =  .11,  ns;  dispositional  negative  affect,  £  = 
-.06,  ns;  and  personal  beliefs  about  EO,  £  =  -.05,  ns. 

Discussion 

Before  discussing  the  data,  we  emphasize  limitations  in  the  present 
study.  First,  the  sample  was  one  of  convenience;  second,  the  data  may  be 
subject  to  method  variance;  third,  because  there  was  no  way  the  individuals 
could  be  identified,  we  were  unable  to  gather  archival,  performance  oata. 

The  finding  that  positive  affect  accounted  for  a  small  amount  of  the 
variance  in  EOCBs  suggests  that  individuals  dispositionally  high  is  positive 
affect  are  more  likely  to  engage  Is  EOCBs.  Moreover,  it  is  consistent  with 
the  mood-altruism  literature.  The  failure  of  Job  satisfaction  to  account  for 
variance  in  EOCBs  questions  the  utility  of  situational  affeot  as  an 
antecedent  of  citizenship  behaviors  and  is  in  contrast  to  work  by  Organ  and 
his  colleagues  (cf.  Organ,  1988). 

The  small  amount  of  varicince  in  EOCBs  explained  by  views  about  EO 
suggests  that  individuals  who  believe  in  EO  are  more  likely  to  act  consistent 
with  their  beliefs.  This  reinforces  the  need  for  EO  training  to  focus  on 
attitude  change  among  individuals  holding  views  not  supporting  EO. 

The  finding  that  equity  perceptions  were  negatively  related  to  grade- 
point  average  was  unexpected.  These  data  may  suggest  that  individuals  who 
perceive  they  have  been  treated  unfairly  may  work  harder  in  EO  training.  Of 
course,  a  number  of  other  person-level  variables,  such  as  cognitive 
complexity,  writing  ability,  and  previous  training  in  the  topic  areas  should 
be  examinee  to  determine  whether  it  is  equity  or  some  other  variable  that  is 
accounting  for  this  variance  in  training  performance. 

Findings  from  this  study  may  have  both  tneoretical  and  practical 
implications.  On  a  theoretioal  level,  the  findings  may  provide  a  working 
framework  to  expiai.n  differences  in  persons'  EOCBs.  On  a  practical  level; 
EXiCBs  may  provi'ie  an  ai Leri'itiLi ve  Oieans  of  Validiiuiiig  wui'k  by  LaXiuiS  aiiu 
Fisher  (1967).  Because  the  indiviauals  came  from  different  duty  stations,  the 
climate  for  EO  measure  may  have  been  less  salient  in  the  deveicpaiant  of  the 
decision  to  manifest  EOCBs  among  individuals  in  this  sample.  However,  the 
measurement  cf  psychological  climate  for  EO  dasoribed  by  Landis  and  Fisher  may 


provide  a  diagnoatic  mothod  of  aaaesaing  &  group  or  organization' a  noma  for 
JED  outcomea.  The  eapirlcal  norms  may  then  be  comparad  with  desired  ones  to 
pinpoint  areas  in  which  organizational  development  efforts  are  needed.  The 
measure  of  climate  for  EO  may  also  be  used  to  make  inferences  regarding  change 
subsequent  to  intervention. 
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Abstract 

To  auppck^  the  perfornance •baaed  selection  of  LCAC  c9>erators,  we 
identified  and  evaluated  a  battery  of  personality,  cognitive,  and  psychomotor 
tests  at  the  Haval  Aaroapaoe  Medical  Search  Laboratory.  Initial  results 
indioate  that  several  tests  are  predictive  of  LCAC  training  criteria.  Twenty- 
sis  LCAC  trainees  took  the  test  battery  prior  to  their  entry  into  the  I^C 
training  prograap  Ve  collected  and  analysed  training  perfornanoe  data  fron  the 
trslnees  at  the  end  ct  the  course  of  training.  Descriptive  statlstloa  and 
oorrelatloo  ooefflcienba  were  derived.  Psyohosotor  and  risk  tost  perforsance 
denoiuitrate  a  slgnifioant  relatioiship  with  the  LCAC  perforaance  criteria. 
Initial  results  indioate  that  the  use  of  ooaputer -based  testing  will  laprove 
the  eelaotioo  of  LCAC  operators.  The  iaplioatltsts  of  these  findings  for  LCAC 
personnel  selection  are  discussed. 


Introdnotlott 

One  of  the  worlds  most  unique  transport  vehicles  is  the  Landing  Craft  Air 
Cushion  (LCAC)  vehicle.  The  LCAC  ’tides *  on  a  cushion  of  air  generated  by 
large  fans  that  allow  it  to  negotiate  both  land  and  water  aurfaoes.  The  LCAC 
is  slailar  to  a  belioopter  In  that  it  has  six  dlaenslons  of  action.  Operating 
the  LCAC  deaaads  unique  perceptual  and  paychoaotor  skills.  In  addltlcss,  with  a 
aachlne  as  expensive  and  Inherently  dangerous  as  the  LCAC,  sound  Judgment  and 
decision -making  also  play  an  important  role. 

As  training '  ooats  escalate  and  projected  plans  call  for  an  increased 
lumber  of  LCAC  vehicles  and  crews,  seleotlng  candidates  who  will  be  successful 
in  the  operation  of  complex  aachinery  becomes  more  orltioal.  In  1988,  the 
Naval  Aerospace  Nedioal  Beseardi  Laboratory  (NAMRL)  oompleted  the  development 
of  a  ooaputer -based  perforaance  assess  aent  battery  for  LCAC.  This  automated 
battery  assesses  basic  information  processing  abilities,  bl^ar  order 
processes,  psyohoaotor  skills,  tiae-eharlng  ability,  and  personality  traits 
that  ai^t  predict  success  in  LCAC  training.  The  teat  battery  was  based  on 
previous  literature  and  research  fron  pilot  selection,  e.g.,  Bordelon  and 
Kantor  (1986);  Demos  and  Gibb  (1986);  Dolgin  and  Gibb  (1986). 

A  (xuaourrent  validity  study  <r.xa mining  Navy  fleet  LCAC  operator  performance 
on  the  automated  test  battery  was  reported  recently  (Ncntasak,  et  aL  1939). 

In  that  study*  several  predictor  tests  were  significantly  correlated  with 
MAAures  of  success  In  LCAC  trainina-  This  report  contains  the  results  of  an 
initial  predictive  validation  of  the  test  battery  for  LCAC  trainees.  Descrip¬ 
tive  statistics  and  Individual  correlations  between  test  measures  and  LCAC 


training  criteria  are  presented.  In  addition,  tlie  relationship  between 
biographioal  Information  and  LCiC  training  criteria  was  evaluated 

Tvo  orlteriOD  maasurea  were  used:  underway  grade  COQ)  and  primary 
training  grade  (PTG).  The  US  is  the  core  crlterica  and  represents  a  composite 
score  reflecting  a  atuoent^  tactical  performance  in  the  training  hovercraft. 
The  FTG  measure  consists  of  ^Q%  classroom  grade  with  the  remainder  reflecting 
tC  scoi*es.  We  did  not  relate  test  battery  asasures  to  specific  oon^onents  of 
LGAC  training.  Past  research  in  flight  training  has  shown  the  difficulty  of 
identifying  reliable  subcriteria  embedded  within  the  more  global  criteria 
(Dolgln,  et  al.  1967a). 

HeUiods 

Subjects 

Student  LC&C  trainees  (H  s  26}  were  selected  for  LCAC  training  on  the 
basis  of  (mrrent  medical  examinations  and  preference.  Subjects  participated 
wluutarlly  and  were  informed  that  the  investigation  involved  performing  tasks 
in  problem  solving  and  perceptual  and  motor  skills.  Subjects  were  briefed  that 
their  test  performance  would  not  affect  their  continuation  in  the  program  or  be 
entered  Into  their  permanent  servloe  records.  Besults  would  be  used  solely  to 
develop  an  improved  seleotion  system  for  the  fiavy.  The  subjects  were  20  to  42 
years  old  W  >  31. 19«  ^  b  5.93).  All  candidates  were  male  and  had  success^ 
fully  completed  a  minimum  of  a  bl^  school  education.  Classification  variables 
were  recorded  for  each  subject  and  Included:  1)  age,  2)  military  ratlng/olas* 
slfleatlon,  3)  amount  of  time  in  the  military,  and  4)  geographical  accession 
araa« 

Apparatus 

All  testing  was  conducted  on  Apple  He  microcomputers  with  control  sticks 
and  foot  pedals.  Subjects  used  an  Apple  He  numeric  keypad  to  respond  to 
discrete  stimuli.  All  responses  were  recorded  to  millisecond  accuracy.  For 
psyohomoto'  testa  (PHT),  two  control  sticks  (Measurement  Systems,  Inc.,  542} 
were  used  for  cursor  oontrol  <biring  the  tracking  tasks.  Oae  control  stick  was 
mounted  in  the  center  on  the  forward  edge  of  a  standard  straight -back  metal 
chair.  The  other  stiok  (throttle)  was  mounted  on  the  left  edge  of  the  chair. 
Additional  apparatus  included  rudder  pedals  patterned  after  those  of  a  Systems 
Research  Laboratory  psychomotor  test  device.  Two  Jaaeoo  JE  520-AP  Voicie 
Synthesizers  were  used  to  present  the  Olchotlc  Listening  (DLT)  letter-digit 
strings  ever  binaural  headphones.  Fiirtber  details  of  the  test  battery  are 
included  in  Oolgin,  et  al.  (1987b)  for  the  Risk  test;  Daaos  and  Gibb  (1986)  for 
the  One -dimensional  Compensatory  Tracking  and  Manikin  tests;  and  Griffin  (1987) 
for  the  PMT  and  DLT  tests. 

Procedure 


All  subjects  were  tested  prior  to  entering  LCAC  training.  Instructions 
were  presented  to  the  subjects  on  the  CRT  for  each  task.  Test  administrators 
intervened  only  to  begin  the  ooaputer  program  for  each  task  and  to  answer 
questions  posed  by  subjects  at  any  time.  The  test  battery  took  from  2.15  to 
2.30  h  to  administer.  A  5-4  min  rest  period  was  given  after  each  t-ask. 
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y  ‘'^i,^wfQvmMat>e  on  the  series  of  psycbosotor  aultitesk  condltioos  correlated 
training  oriterlsu  Table  1  lists  the  tests  that  oorrelated  sigoifloantay 
«i^  traisiius  oriteria.  When  perforsed  in  ooabiaation  irith  the  SIT,  PKT  tasks 
indioatMl  a  aoderate  reXationhhip  to  both  IX!  and  PT6  with  ooefficients  ranging 
f^a>  to  As  expected,  the  X  oorrelatifxis  vera  higher  than  those 

derliq^  for  PTQ  beoause  X  reflects  the  aye^^umd^foot  oocrdtnatlon  segment  of 
I'TQ*  These  oorrelstioos  were  in  the  expected  direotion.  That  Is,  greater 
pafbhoaotor  tracking  error  was  associated  with  lower  overall  primary  training 
£ire<b»s. 

The  error  scores  from  tiie  combined  stick 'throttlennidder  tasks,  without 
the  SIA,  only  yielded  a  oorrelation  of  *^20  with  PTG.  Whan  X  was  used  as  the 
criterloa,  the  oorrelation  was  slightly  higher  (>w22X  Though  cot  statisti¬ 
cally  significant,  these  were  also  in  the  e:q»eoted  direotion. 


Risk  Test 

When  personality  attributes  were  analyzed,  the  risk  test  was  sigoifloantly 
related  to  PTS  but  not  to  X.  The  mmbsr  of  boxes  selected  was  significantly 
related  to  the  PTG  criterion  (r_  z  .46,  £_  <  .05,  |a  z  26}.  Response  time  on  the 
test,  hcwe-ver,  did  not  deaonstralU  a  signifioant  relationship  with  either 
training  criteria 

Sublets*  age  Indioated  sighifiaantly  negative  oorrelati^is  to  both  X  and 
PTG  (r  z  -.40  and  -.46,  <  .05,  n  z  26).  The  older  the  subject,  the  greater 

the  dTcreaent  in  XiC  training  perfornanoe. 

TABLE  1.  Suamary  of  Signifioant  Correlation  Values  between  Test  Measures  and 
Training  Criteria 


Test  neasure 

Underway  grades 

Primary  training  grades 

PMT  (error  score } 

Stick -rudder  XT 

-.  48» 

44* 

Stick -throttle  +  DLT 

-.  46* 

-.41* 

S tl ok -ru dder -throt t le 

♦  XT  46* 

-.40 

Risk  taking 

Mo.  of  responses 

.36 

.46* 

Age 

.40* 

-.46* 

*  £_  <  .05,  two-taJ  led 
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CogpeiuMitory  Tracking 

The  a^r&0s  ouHUilatj.'ve  distanoe  off  t&rget  (CSOT)  error  for  the  final 
thras  trlalh  of  the  task  was  used  beoause  it  is  stable.  Aver&go  CDOT  error  was 
M  *  27,97*  ^  =  13.74  for  LCAC  trainees  (n_  s  26).  Both  DG  and  PTG  correlated 
equally  with  average  C1X)T  ^  e  -.20%  When  the  one >di mens ional  compensatory 
tracking  task  was  performed  in  oombinaticm  with  the  digit  canoelation  task,  the 
oorrelatioD  between  average  COOT  and  HO  remained  at  r_  =  >>^.20.  The  correlation 
between  average  CDOT  and  PTG  was  r^  s  -^25.  None  of  these  oorrelation  ooeffi- 
oients  was  signlf leant  at  the  .05  level. 

Dlohotic  Liatening  Task 

Kane  of  the  four  I^T  measures  Indicated  significant  correlation  to  the 
training  orlteria.  Singla^DLT  demonstrated  a  weak  oorrelati(»i  to  OG  (r_  =  .17) 
and  to  PTG  (r^  s  .13X  The  three  aultl-WiT  measures  yielded  no  relationship  to 
eltiier  oriterlon. 

Manikin  Test 

The  correct  reaction  times  for  the  last  four  trials  of  the  Manikin  task 
were  stable  and  were  averaged  for  use  as  the  independent  measure.  Mean  (SD) 
oorreot  reaction  time  was  1.74  with  an  ^  of  .53  (n  s  241  Mean  correct 
reaction  time  on  the  task  correlated  e  .  17  with  both  OG  and  PTG  (n  =  24X 
Manikin  number  oorreot  (M  *  79.04,  SD  s  19.45,  n  *  24)  correlated  (r_  *  .14,  n  = 
24)  with  OG  and  PTG  (r_  b  .f2,  n  =  24).~The  Manikin  test  did  not  display  any 
significant  relationship  to  the  training  criteria. 

dsaussioQ 

The  psyohomotor  task  performed  in  oomblnatloa  with  the  dlohotic  listening 
task  were  significantly  related  to  both  the  DG  and  PTG  criteria.  Of  the  two 
risk  test  measures  (aua^r  of  boxes  selected  and  response  time),  the  mmber  of 
boxes  selected  correlated  significantly  with  the  LC^  training  criterion.  Our 
results  also  showed  that  age  was  slp^ficantly  related  tc  the  successful  00m- 
pletioc  of  the  LCiC  training  prograai.  These  results  provide  support  for  the 
notion  that  certain  abilities  and  personality  traits  (as  measured  by  several 
tents)  may  be  useful  in  screening  individuals  for  the  LCAC  training  program. 

Subjects  trtio  perform  better  (lower  error  score)  on  the  multitask  tests 
appear  to  have  a  greater  likelihood  of  success  in  the  training  syllabus.  Those 
subjects  with  a  moderate  risk-taking  propensity  also  display  the  characteris¬ 
tics  that  appear  to  facilitate  completion  of  training.  Additionally,  younger 
subjects  tend  to  perform  better  In  the  program.  Taken  together,  these  <^arao- 
teristlcs  should  be  considered  impoi^ant  In  the  initial  LCAC  personnel 
screening  process. 

The  variables  Identified  in  our  study  appear  promising  for  more  accurately 
predicting  1)  those  who  will  fall  from  training,  and  2)  actual  LCAC  performance 
in  the  primary  portion  of  tactical,  underway  training.  The  latter  is  very 
important  in  that  the  ability  to  predict  who  will  perform  well  in  LCAC  training 
enables  pre -identification  of  the  successful  trainees. 

Due  to  our  relatively  small  sample  size,  these  results  should  be 
considered  preliislnary  with  minimal  generalization.  The  current  findings 
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.  of  an  Imxroirad  LCIC  salaotion  ay«t«a  that  may  both 

»wi»ufc  wrt  •mwivwmrfr  *uv  «*>aa4^  -gaow  ^mi  a  *  yj  wa  4.u  vue  <(#«Aa  4441  v>« 

r«uii«iu*c^  and  avaltaitlac  of  the  mild  teats  in  the  battery  with  an 
t£AC>^'*sinee  popQlstloo  should  provide  considerable  advances  over  present 
soreendfig  tedbnlqaes. 
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ABSTRACT 

Present  mSitary  occupatkmai  analysis  giethodok^ies  focus  on  the  identification  of 
job  tjfges  wtUtio  an  occupadoa  and  analym  and  ewaluatioa  of  initial  skills  training  pregrams. 
New  methods  have  recentfy  been  developed  whkh  help  identic  career  paths  including 
assignment  probrinBties  az^  associated  training  required  for  job  masteiy.  By  integrstii^  Job 
and  Training  lEstory  surv^  infernuuion  with  job  analysis  data,  a  more  comprehensive  mode! 
of  occupational  career  paths  can  be  developed.  Such  dynamic  models  of  specialties 
represent  a  significint  enhancement  of  the  current  job  auJ^  technology. 


P.eceat  developments  in  oceupational  analysis  and  training  research,  as  well  as  in  .Air  Force  decision 
making  processes,  have  created  new  t^iportunities  for  o^AiiBizing  manpower,  personnel,  and  training  (MPT) 
planning  and  dMssion  maldng.  Such  develoianents  iadnde  the  recent  emergence  of  Utilization  and  Training 
Workshops  (UdfTWs)  and  Tnuiving  Planning  Teams  (TPTt)  tbe  primary  vehides  for  making  major 
training  decisions.  Such  innovative  procedural  changes  also  make  obvious  a  need  for  a  technologic^ 
advanced  data  generation,  anaiyss,  and  evaluadon  capability.  To  make  good  MPT  decisions  about  an  APS 
or  weapons  system,  decision  makers  must  be  able  to  visualize  and  undersund  the  jobs  and  training  programs 
of  the  AFS  cv  weapon  system  under  consideration,  as  well  as  the  relauve  cosa  and  payoQs  of  various  training 
options.  Sudi  a  'modcT  of  an  APS  provides  a  concise  summary  of  its  current  status,  creates  a  common 
Tai^uage*  for  discussion  or  rwgotUtion,  and  forms  the  baseline  against  which  various  proposals  or  options 
can  be  evahiated. 

The  Air  Force  presently  uses  a  task4>ased  approach  to  evaluate  initial  skills  technical  training  content 
and  review  personnrJ  dassifiration  and  utilization  policies  (Cbristal,  1974;  Mitchell,  1988).  As  part  of  the 
occupational  analysis  (OA)  process,  tasks  are  defined  by  subject-matter  experts  (SMEs)  of  an  AFS  in  their 
own  technical  terminology,  wt^king  with  analysts  of  the  USAF  Occupadonal  Measurement  Center,  Randolph 
Air  Force  Base,  Texas  (see  AFR  35-2).  Several  Idiuis  of  data  on  th&e  tasks  are  collected  from  job 
incumbents  and  supervisors  for  use  in  reviewing  training  programs  (see  ATCR  52-22).  Large  samples  of 
incumbents  arc  asl^  to  provide  informatkm  about  which  tasks  they  perform  in  their  present  jobs  and  the 
relatr.T  amount  of  their  job  time  spent  perfonning  such  tasks.  These  data  arc  used  to  exambe  the  variety 
of  specialized  jobs  within  an  AFS  (occupation),  to  assess  how  jobs  change  at  advanced  skill  levels,  and  to 
review  official  AFS  descriptions  and  initial  training  programs  (Christal  &.  Weissmuller.  1988;  Mitchell,  Ruck, 
&  Driskia,  1988). 


TECHNICAL  AFPROACTl 

To  provide  adequate  support  for  advanced  training  decision  making,  the  Air  Force  Deputy  Chief  of 
Staff  for  Personnel,  Education  and  Training  (HG  USAF/DPPE)  requested  that  the  Air  Force  Human 
Resources  Laboratory  (AFHRL)  develop  a  computer-based  Training  Decisions  System  (I  DS)  to  augment 
the  Air  Force  ISD  model  This  prototype  system  generates  necessary  froni-cnd  training  requirements  data, 


rrifAww  Afgrtrirhwis,  and  procedures  kr  improved  IsleractiOB  among  training,  personnel,  and 
focuses  on  supp<»tia^  Air  Force  mtaugcn  in  making  dcosioas  as  to  the 
and  vwfeen  of  the  fcdiaical  traiolog  (iododiag  the  OJT)  reqidred  for  an  AFS  (Ruck,  1982; 

MitchnU,  Yadridc^  Perria,  Knight,  Eschenbrenner,  Ruetsr,  &  Feirisott,  1989). 

The  TDS  meets  the  requkemeni  for  a  technciojpcally  advanced  MPT  decision  support  system.  The 
TDS  mchides  procedures  for  buildisg  data  bases  coacermsg  the  dynamic  ftov'  of  people  through  jobs  and 
^^cemmg  bo&  the  fanoal  traiiuog  and  OJT  required  to  support  a  djnamic  job  flow.  Furthermore,  the  TDS 
inchides  modeling  and  optimizatkm  capaMkies  which  pro^^  estimates  ^  training  quantities,  costs,  and 
capaci^  Sac  faothimxoai  training  and  OJT.  These  modeling  capabilities  allow  the  TDS  to  go  beyond  simply 
describiog.the  cuetcnl  skuatiooin  an  AFS~TDS  can  model  alternative  scenarios  which  reflect  poss3>le 
pc^ky  Oftfions.  This  m<vti».1in£  capability  b  used  to  study  trade-offs  between  formal  training  and  OJT  for 
meeting  particular  task  training  requiremenxs. 

For  TDS,  a  model  of  the  specialty  being  studied  b  devclt^^  in  the  form  of  a  graphic  Qow  diagram 
<d  the  current  Udfization  it  Trabdcg  (U&T)  pmters  (see  Figure  1  for  an  example),  as  well  as  narrative 
suausiaries  (tea  de&orqitiwe  purpeses  ai^  later  use  in  surveying  the  U&T  pattern  preferences  of  manners; 
sec  Yadrick,  Knigfu,  Mitchell,  Vaxg^wi,  6t  Perrin,  1988).  Such  agraphic  display  provides  some  sense  of  the 
flow  of  individuab  threw^  training  programs  and  jobs  but  docs  not  tend  itself  to  stimmarixing  the  various 
types  of  quandudve  iafbnnation  immlvBd,  such  as  the  number  of  individuab  enterix^  the  Geld  each  year, 
or  tibe  various  probabiliti«  of  reassigQmettt  among  jobs,  attendittg  advanced  tedmical  trainiug,  or 
paTttdpatiag  in  Professional  Military  Eductfion  (PME)  courses. 

One  of  the  thing*  needed  to  create  a  dynamic  picture  of  a  specialty,  b  data  on  the  assignment 
probability  to  each  job  and  to  eadi  training  program.  Such  data  are  needed  to  understand  the  flow  of 
personnel  born  aac  job  to  another  Much  generates  new  OJT  requirements  each  year,  as  well  as  calculate 
auendance  at  FTDs,  PME  courses,  and  other  training  programs.  Personnel  records  have  some  of  thb 
information  but  job  assignments  are  not  conastently  record  in  a  way  which  can  be  translated  to  recognized 
OSR  job  types  (except  where  a  job  title  includes  such  designators  as  *NCOIC*). 


Figure  L  Cu-nrent  U&T  PaUcra;  Environmcmal  S>-stcai5  Mabltuancc  (AFS  423X1) 


For  first  peai^wd  (defined  geaeraliy  as  :.admdujals  in  tfacu*  first  24  aaonths  ia  the  ipecialty),  the 
prdMbtlky  ftf  hfeiwg  tn  »  g^n  jnh  is  cquai  JO  the  propoTtiofi  of  people  with  1  >  24  months  Total 

Aetb<e  Fedenl  MilUaty  Service  CTAFMS)  io  those  jcil>  ^  whidi  we  cut  apptaxmatc  from  the  OSR  data.  This 
is  com^icated  some«^  fay  attrition  out  of  the  specu^ty  (or  cut  of  the  Air  Force)  aod  crossflow  from  other 
spccia^es.  What  we  really  need  is  a  more  loagtudinai  picture  of  how  people  move  from  job  to  job,  or  from 
given  jobs  oot  of  the  caueer  field. 

To  develqit  tids  kind  of  infomatioa,  we  designed  a  Job  and  Traimng  History  survey  (ITHS)  which 
asked  present  job  acmabeats  to  indicate  which  jobs  they  had  held  at  what  points  in  time,  as  well  as  which 
courses  they  had  attended.  The  sample  was  sd^ed  from  the  OSR  data  files,  to  insure  that  we  had  all  of 
the  job  groups  identified  in  the  GSR  represented  in  the  sample.  A  separate  random  sample  of  new  recruits 
(1-48  mmtths  TAFM$)  was  developed,  to  assess  any  recent  trends  in  assignment  policy.  The  survey  was 
administered  through  local  base  Survey  Control  Officers. 

For  the  Environmental  Systems  Maintenance  specialty,  AI^  423X1,  the  JTHS  form  included  a 
background  section  and  a  listing  of  nine  jobs  with  space  to  indicate  dates  of  assignment;  each  job  was  defined 
ia  terses  of  its  characteristic  Task  Modules.  Separate  sections  of  the  survey  asked  for  dates  of  mtendance 
in  any  formal  training  program.  Job  incumbeols  were  encoura^  hs  fill  in  any  courses  not  li^ed.  Thedata 
odlected  appeared  realistic  and  proved  very  useful;  a  bri^  validity  check  apin.^  known  school  attendance 
rates  mdicatal  good  cocreq>ondegce  between  data  sets. 

Once  the  average  length  of  assignment  is  detennined  from  the  JTHS,  the  ASCII  CODAP  Group 
Membership  Selection  (MEMSEL)  program  is  used  to  sort  cases  into  job  type  membership  per  average 
asrignment  period.  Other  CODAP  routines  are  used  io  calnrlatr.  the  proportion  of  total  cases  in  the 
assignmeut  period  per  cell  (each  job  type  per  average  assign  meet  period).  The  product  is  an  ordered  array 
of  numbers  interpretaUe  as  assignment  probabilities  M  each  career  point,  as  represented  by  TAFMS  periods. 

VTuh  this  kind  of  distributional  data,  it  is  possible  to  flesh  out  the  graphic  display  (;^bown  as  Figure 
1)  of  how  jobs  and  training  pn^rams  relate  to  one  another  throughmtt  a  career  in  the  spedaity.  The  graphic 
display  is  an  effective  communicative  tool,  but  does  not  lead  itself  to  summarizing  the  quantitative 
information  involved  in  modeling  a  U&T  pattern,  such  as  dhe  number  of  individuals  entering  the  field  each 
year,  or  the  probjdiilities  of  reassignment  among  jobs,  attending  advanced  technical  training,  or  leaving  the 
AFS. 


In  the  TDS,  these  kinds  of  data  are  used  b  a  dynamic  simulation  program  to  estimate  annual  Hows 
of  individuals  through  jobs  and  trainii^  activities,  including  the  hours  of  on-the-job  traicing  (OJT)  required 
for  each  person  to  master  their  particular  job.  Such  a  simulation  permits  us  to  cstima: ..  the  costs  of  OJT 
required  in  a  year  as  well  as  fcHmat  training  costs.  likewise,  such  a  simulation  penni  s  us  to  estimate  the 
training  capacity  of  representative  field  units  (see  Vaughan,  ct  aL,  1989). 

This  very  flexible,  Task  Module-based  approach  to  esiimating  training  requirements  and  job 
assignment  probabilities  within  an  Air  Force  spedaity  also  facilitates  the  examioatioa  of  possible  changes 
to  AFS  jobs  or  associated  training  programs,  llie  TDS  deals  «ith  such  proposed  changes  as  an  Alternative 
U&T  prMtern.  Once  the  details  of  how  such  a  change  would  impaa  job  contmit  and  trainuig  programs,  the 
simulation  program  can  be  rerun  so  as  to  estimate  training  requirements  under  the  alternative  configuraiion. 
These  are  used  to  calculate  training  cost  and  capacity  estimates  for  the  alternative,  which  arc  compared  to 
present  costs  to  evaluate  the  possible  impacts  of  the  proposed  changes. 

Figure  2  illustrates  an  example  of  an  alternative  configuration  for  AFS  423X1  which  was  suggested 
by  some  senitu'  NCX>s  as  a  potentially  valuable  change.  In  this  alternative,  jobs  and  training  programs  arc 
specialized  by  large  and  small  aircraft,  so  individuals  can  develop  a  full  career  path  on  one  type  of  system 
or  the  other  foui  oot  be  required  to  maintain  both). 


NOFTD 


Figure  2.  AUcTBarivc  U&T  Pattern  for  Spedaliziag  AFS  423Xi  Jobs. 

Cost  esdnutes  for  this  alternative  loclude  S2.4  mOHon  for  fonoal  courses  and  SS20  thousand  for  OJT 
(versus  $19  numan  for  courses  and  SS3G  thousand  for  CJT  in  the  current  U&T  pattern).  Such  spedalization 
would  be  more  e:qpeasive  (roughly  half  a  muiion  dollars  per  year)  but  does  sot  exceed  the  OJT  capacity  of 
held  oohs.  Tims,  h  is  a  feasfi^s  option,  but  only  if  additional  funding  can  be  obtained. 

DISCUSSION 

Present  occupadooal  analysis  methodologies  focus  primarily  on  the  identifiesaion  of  job  types  and 
assessment  of  initial  skills  training  programs.  New  TDS  methodologies,  such  as  Job  and  Training  History 
surveys  and  the  U&T  sunoiadon  program,  now  make  it  possibic  to  examine  the  dynamics  of  a  specialty, 
klentify  career  paths,  estimate  job  assignment  pr<d>abilities,  and  calculate  the  hours  of  training  required  for 
job  mastery.  By  integrating  JlliS  infonnadon  with  OA  data,  a  more  comprehensive  model  cf  an  AFh  can 
be  devdoped.  Further,  it  is  cow  pos^le  to  assess  the  impaa  of  proposed  changes  in  an  AFS  in  terms  of 
total  training  ct»ts  and  training  capacity  constraints.  Such  models  represent  a  significant  eohancement  of 
the  current  jd>  analysis  technology,  and  have  (he  potcndal  for  substantially  improving  MPT  planning  and 
decision  making. 
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Abstract 


At  the  1988  base- level  logistics  conference  held  at  the  United 
States  Air  Force  Academy  (USAFA),  senior  logisticians  discussed  the 
need  to  in^rove  methods  for  informing  officer  candidates,  particularly 
at  the  Academy,  of  the  challenges  and  rewards  of  a  career  in  logistics. 
Based  on  Air  Force  force  characteristics,  USAFA  graduates  are 
underrepresented  in  the  logistics  career  field.  The  Air  Force  Logistics 
Management  Center  (AFLMC)  and  the  Air  Force  Military  Personnel  Center 
(AF>WC)  designed  and  administered  a  survey  to  USAFA  graduates  serving 
in  the  logistics  career  field  (N-472).  The  survey* s  purpose  was  to 
detenaine  perceptions  of  logistics  and  associated  USAFA  curricultm} 
junior  and  senior  officers  had  as  cadets.  Additionally,  we  identified 
current  satisfaction  of  USAFA  graduates  regarding  the  logistics  career 
field.  While  attitudes  regarding  the  career  field  were  somewhat  negative 
for  the  USAFA  cadet,  there  is  satisfaction  with  a  career  in  logistics 
after  working  in  the  career  field. 


At  the  1988  base-level  logistics  conference  held  at  the  United  States  Air 
Force  Academy  (USAFA),  senior  logistics  function  representatives  (primarily  in 
the  grade  of  Colonel)  discussed  USAFA  graduate  representation  in  logistics  and 
how  the  Academy  prepares  graduates  for  a  logistics  career.  Some  believed  that 
Academy  graduates  were  not  represented  adequately  in  logistics  career  fields 
and  that  the  graduates  were  not  adequately  prepared  by  the  Academy  to  enter 
the  logistics  career  field.  Others  felt  Academy  cadets  did  not  perceive  a 
l^istics  assignment  as  favorable.  At  the  conclusion  of  the  conference,  the 
Air  Force  Logistics  Management  Center  (AFLMC)  was  tasked  to  investigate  these 
concerns  and  submit  a  report  on  USAFA  graduates  in  logistics. 


Method 


Subjects 


Surveys  were  sent  to  472  Academy  graduates  currently  serving  in  a 
logistics  assignment  (004X,  008X.  009X,  31XX,  40XX,  60XX.  62XX.  64XX,  65XX, 
66)0()  as  of  March,  1989.  Of  472  officers,  362  completed  and  returned  the 
survey  for  a  response  rate  of  77%.  Forty-nine  percent  are  field-grade  and 
51%  are  company-grade  officers.  Ihirty-five  percent  entered  logistics  on  a 
direct  duty  assignment  from  the  Academy,  22%  are  flight  training 
elininees,  and  32%  entered  logistics  later  via  career  broadening,  cross 
training,  or  as  a  rated  supplement  assignnient. 


Apparatus 


The  survey  was  organized  into  three  sections;  Background,  Academy 
Preparation,  and  Job  Satisfaction.  The  Background  section  enhances  analysis 
of  the  overall  survey  based  on  factors  such  as  grade,  gender,  and  major 
command.  Academy  Preparation  centers  on  the  perceptions  graduates  had  as 
cadets  of  how  the  Academy  prepared  them  for  logistics  careers  such  as  the 
amcunt,  sufficiency,  and  source  of  logistics  information  presented. 

Res{^ndents  answered  Job  Satisfaction  questions  from  a  present  perspective  cf 
their  logistics  jobs  and  addressed  issues  such  as  pro»aotion  potential,  working 
conditions  and  desire  to  transfer  to  another  AFSC. 


Procedure 


Force  characteristics  were  obtained  from  the  Air  Force  Military  Personnel 
Center  (AFMPC)  to  identify  the  representation  of  USAFA,  OTS  and  ROTC  graduates 
throughout  the  Air  Force  and  within  logistics  as  of  March,  198S.  Policy 
documentation  was  researched  to  determine  some  of  the  reasons  for  currci.t 
force  structure  characteristics  as  indicated  by  demographic  data.  Also,  1r. 
order  to  obtain  an  assessment  of  perspectives,  the  AFUC  and  AFMPC  developed 
and  administered  an  attitude  and  opinion  survey  to  all  USAFA  graduates  in 
logistics  career  fields  and  analyzed  the  returned  data. 


Results 


Force  characteristic  data  indicate  that  13%  of  Air  Force  officers  have 
coase  from  the  Academy.  Yet,  only  five  percent  of  individuals  in  the  logistics 
career  field  are  Academy  graduates.  There  are  several  reasons  for  this 
underrepresentation.  By  comparing  percentages  of  Academy  graduates  in  each 
career  area  to  the  percentage  of  graduates  in  the  entire  Air  Force  (13%),  we 
can  get  a  better  idea  cf  just  how  well  Academy  graduates  are  represented  in 
logistics.  The  results  of  this  reveal  that  International  Political  and 
Military  Affairs  (19%),  Operations  (18%),  and  Scientific  and  Developmental 
Engineering  (16%)  h^ve  a  prooortion  greater  than  13%,  while  logistics  career 
arecs  have  only  5%  Academy  graduate  representation  (Roberts,  1989).  Primary 
reasons  for  this  are  the  requirement  for  at  least  65%  of  each  graduating  class 
to  enter  Undergraduate  Pilot  Training  (UPT)  and  lack  of  logistics 
ecucation/emphasis.  While  these  are  causes  for  present  proportions,  recent 
Air  Force  policies  and  procedures  (Boles,  1989;  Hanin,  1989;  Hickey,  1989)  vvill 
roost  likely  decrease  Academy  representation  even  further  in  the  future. 

Air  Force  policy  states  that  the  oiajority  of  Academy  cadets  (at  least 
65%),  immediately  upon  graduating,  enter  Undergraduate  Pilot  Training  (UPT) 
and  remaining  graduates  receive  Category  A,  Bl,  B2,  or  C  functional -area 
assignments,  two  logistical  career  fields,  31XX  (Missile  Maintenance)  and 
40XX  (Aircraft/Munitions  Maintenance)  are  Category  A  assignments,  and  five 


logistical  career  fields,  69XX  (Transportation),  62XX  (Services),  64XX 
C^pply  Hanagefflsnt),  65XX  (Acquisition  Contract ing/Hanufacturing)  and  66XX 
(Lcglscics  Plwis  and  Programs)  are  Category  B1  assignments.  Most  Acaderay 
graduates  who  do  not  issediately  enter  UPT  receive  A,  81,  or  B2  assignments. 
The  assigrosent  process  has  recently  changed  for  graduates  initially  entering 
UPT  but  not  finishing.  Under  the  previous  policy,  these  officers  would  be 
reassigned  to  a  Category  A,  Bl,  82,  or  C  position.  The  new  policy  is  to 
reassign  them  to  only  Categery  A  positions,  this  a«dns  that  31XX  or  40XX 
AFSCs  are  now  the  only  logistics  AFSCs  UPT  elirainees  ere  pereitted  to  enter. 
But  even  though  the  number  of  Academy  graduates  within  logistics  career  areas 
is  of  major  concern,  an  equally  inspcrtant  topic  is  the  attitudes  and  opinions 
of  those  Academy  graduates  already  in  a  logistics  AFSC.  Most  Academy 
graduates  (8i%)  said  that  the-  amount  of  logistics  career  field  Information 
provided  at  ths  Academy  was  not  sufficient  for  entry  into  logistics.  Many 
also  scid  that  they  received  either  “no  logistics  career  field  information'- 
(3M)  or  “a  little  logistics  career  field  inforsation"  (44%).  Of  those 
indicating  some  information  haa  been  orcvided,  they  Identified  CONUS  field 
trips,  instructors,  professional  military  studies  and  training,  and  Career  Day 
as  tlic  primary  sources.  However,  the  largest  group  of  respondents  (31%) 
believe  they  were  at  least  fairly  well  prepared  by  the  Academy  for  their 
current  logistics  assignment.  Moreover,  most  (54%)  believe  they  were  somewhat 
better  prepared  than  their  OTS  and  RGTC  courterparts  due  to  leadership  and 
oilitary  training  at  the  Academy  (Roberts,  1989). 

In  gauging  how  well  the  Academy  is  portraying  logistics  assignments  to 
Academy  cadets,  about  half  (55%)  said  they  did  not  perceive  logistics 
assignments  favorably  while  at  the  Academy  and  81%  said,  as  a  cadet,  they 
perceived  a  logistics  assignment  as  a  “second  rate  job."  Possibly  as  a 
partial  result  of  this,  a  logistics  AFSC  was  not  the  first  choice  of 
assignment  for  72%  of  these  graduates.  Additionally,  most  respondents  believe 
personnel  fri)®  non-logistics  AFSCs  disc  pe:*ceive  logistics  as  a  poor  AFSC  in 
wliich  to  work.  Still,  most  Academy  graduates  in  logistics  changed  their 
perspectives  once  in  the  career  area.  Most  are  satisfied  with  their  present 
assignment  (54%).  While  they  believe  promotion  opportunities  to  either 
Colonel  (^%)  or  iieneral  officer  I'ank  (82%)  are  below  average  or  poor,  it  is 
fair  to  excellent  (85%)  up  to  this  point.  Strang;ely  enough,  while  43%  believe 
their  promotion  opportunities  are  worse  than  those  throughout  the  rest  of  the 
Air  Force,  66%  say  they  would  not  improve  their  situation  by  being  in  other 
non-rated  AFSCs.  Perhaps  this  is  because  over  half  would  not  transfer  to 
another  AFSC  at  tnis  point  in  their  careers.  Eignty-six  :»ercent  believe  that 
either  the  Aircraft  Maintenance  and  Munitions  or  the  Acquisition 
Contracting/Manufacturing  carser  areas  are  the  most  desirable  even  though  most 
of  these  respondents  are  in  other  logistics  AFSCs.  Ending  on  a  positive  note, 
57%  indicated  their  current  working  conditions  are  gaod  or  very  good.  These 
results  did  not  significantly  differ  with  respect  to  grade  or  time  in  service. 


Discussion 


The  inid’fit  of  11:  i?  project  was  Lo  identify  Curt  et;;.  'orCe  ilriiCtUie 
characteristict  and  collect  attitude  and  opinion  data  frea  USAFA  -graduates  in 
logistics  AFSCs.  It  was  not  to  evaluate  Ai:  Force  policy  on  Acaderay  graduate 


-  V'SrV-*  • 

assi^naents  even  though  we  have  identified  that  present  policy  affects  Academy 
graduate  representation.  However,  it  may  be  appropriate  to  look  at  the 
maximum  direct  duty  assigraaevst  quotas  from  the  Academy  at  some  future  point. 
Unfavorable  attitudes  held  as  cadets  may  also  be  responsible  for  low 
representation.  Survey  results  indicated  there  would  be  many  volunteers  from 
various  base/wing  level  logistics  organizations  willing  to  discuss  the  many 
benefits,  regards  and  challenges  cf  becoming  a  logistician  to  Academy  cadets 
during  Career  Day  or  other  formal  programs.  And  even  though  graduates  do  not 
believe  they  mre  well  prepared  for  the  technical  aspects  of  a  logistics 
career,  it  was  beyond  the  scope  of  this  project  to  objectively  measure 
respondents'  job  performance  and  prove  this  one  way  or  another.  It  is 
interesting  to  note  that  while  graduates  did  not  have  a  positive  attitude 
towards  logistics  as  cadets,  these  opinions  changed  after  experiencing  the 
challenges  and  »-ewards  of  a  logistics  assignment. 
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Abstract 

This  pap>er  establishes  the  correlation  between  6-52  Weapon 
Trainer  (WST)  perfiorroance  and  one  Oodiqpit  Resource  Managetnait 
(CBM)  tool,  the  LTME/MOST  worksheet  (for  a  simsoeury  see  Helmreich  & 
Wilhelra,  1969).  Ihrotgh  further  examination  of  this  relationship, 
the  authors  recocxnerKl  specific  behaviors  to  enhance  CRM  skills  and 
identify  2in  informational  basis  for  situational  awargiess  (SA). 

The  primary  goal  of  CRM  resetarch  is  to  improve  crew  effectiveness,  bvit 
regardless  of  the  quality  of  interrelational  skills  a  crew  exhibits,  task 
acccmplishment  requires  a  solid  informational  base.  Many  researchers  have 
defined,  and  to  some  degree,  quantified  the  coggosition  of  the  data  necessary 
for  a  pilot  to  effectively  perform  a  mission  (for  a  review,  see  Pracker, 
1988).  Ihese  attempits  to  operational  ize  the  term  sitmtional  awareness  have 
centered  on  the  perspective  of  the  individual  pilot.  FOr  a  crewed  aircraft 
hcxirevea:,  these  efforts  are  certainly  applicable  to  the  pilot-in-ooranand  since 
he  beairs  the  ultimate  responsibility  for  the  safe  conduct  of  the  fli^t,  yet 
insufficient  for  the  crew  as  a  whole.  All  crew  members  must  maintain  an 
awareness  of  the  dynamic  relatlonship>s  betweai  the  aircraft  and  several 
rapidly-changing  variables  and  er^lcy  CRM  skills  to  accurately  assemble  and 
utilize  this  kriowladge 

Seversd  investigators  have  identified  information  transfer  as  e  group 
process  variable  indicative  of  effective  performance.  Aocording  to  Foushee  & 
Helmreich  (1988),  information  flow  is  **cne  of  the  most  significant"  (p.  209) 
paredictors  of  p>erfomance,  and  Lanzatta  &  Roby  U960)  state  that  "the  vay  a 
groqp  ‘utilizes'  its  resources  and  the  procedures  it  arploys  for  oomomicating 
essential  information  are  as  in?Jortant,  if  not  more  iir^ortant  than  'knowledge' 
of  the  problan  for  determining  its  pjerformance"  (p.  145).  In  an  op>erational 
Strategic  Air  Ocninand  (SAC)  B-52,  efficient  and  effective  information  transfer 
is  impjerative  due  to  the  physical  separatioi  of  the  aviation,  offensive,  euvi 
defensive  crew  positions.  The  fact  that  tlie  aircraft's  interphone  system  is 
the  primary  medium  through  vhich  a  B-52  crew  maintains  situational  awareness 
affords  a  unique  research  opp»rt.unity.  Since  crew  mentoers  verbalize  their 
understanding  of  the  situation,  it  seems  that  an  euialysis  of  interpS’ione 
ccnmunications  might  pxrovide  (1)  an  assesaraent  of  CRM  skills  and  (2)  evidence 
in  support  of  the  theoretical  content  of  the  situational  awareness  construct. 

Method 

Subjects 

Seven  opjerationai  B-b2  creio  served  as  subjects,  in  an  effort  to  ensure 
a  wide  range  of  jjerforwarxie,  the  authors  selected  crews  following  proctdures 
suggested  by  Helmreich,  Foushee,  Benson  &  Rusaini  (1965)  auid  Ginnett  (1997). 
Squadron  Op>eration8  Officers  reinked  crews  on  the  basis  of  overall  miarton 
capability  and  one  experimenter  chose  crews  from  the  top  and  bottom  thirds . 
The  othar  experimenters  were  not  aware  of  overall  crew  ranking. 
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Procedure  and  Apparatus 

When  each  crew  arrived  at  the  VBT  facility,  the  experiroancers  introduced 
themselves,  explained  the  purpose  of  the  research  and  stressed  the  aixanyious 
nature  of  the  data  collection.  Representatives  from  the  First  Combat 
Evaluaticxi  Group  (ICSVG),  the  SAC-wide  standardization  and  evaluation 
division,  presented  a  realistic,  stort-notice  tnission  briefing,  and  allowed 
the  crevB  15-20  minutes  to  review  the  scenario  before  proceeding  to  the  WST. 
Crews  flew  a  simulated  cxaibat  missLori  in  the  E-52  WST  vhich  has  high-fidelity 
crew  positions  for  all  six  crew  members:  pilot  (P)  and  copilot  (C)  in  the 
aviation  module?  radar  navigator  (R)  and  navigator  (tJ)  in  the  offensive 
module;  and  the  electronic  warfare  officer  (E)  and  giamer  (G)  in  the  defensive 
module.  It  is  equipped  with  an  <xit“the-window  visual  system  in  the  aviation 
module  and  provides  an  exteiisive  capability  for  simulatirq  a  wide  range  of 
threats,  malfunctions,  and  environmental  conditions.  The  ICEVG  personnel 
developed  a  realistic,  hic^  workload,  wartime,  mission  scenario  for  use  in 
this  study.  Ihe  mission  involved  takeoff,  flight  through  various  threats, 
a  malfunction  necessitating  crew  iiiteraction,  attack  of  a  fjeavily  defended 
enemy  target,  and  navigation  to  friesidly  territory.  The  scenario  incorporated 
the  char2uh:eristics  and  features  of  Mission-Oriented  Simulator  Training  and 
crews  flew  the  entire  profile  without  instructor  intervention.  During  each 
simulator  sortie,  three  highly- trained  CRM  obser\'er9  manually  recorded  all 
canmsnications .  'nue  ICEIVG  ooservers  and  the  local  simulator  instructors 
ranked  crews  on  mission  performance  as  defined  by  threat  avoidance  and  badaing 
accuracy.  After  the  simulator  sortie,  the  1CE\’G  personnel  d^riefad  crew 
martaers  on  their  performance  and  CRM  observers  rated  each  crew  using  the 
line/most  '.forksheet.  After  oonpiling  transcripts,  tlse  authors  evaluated  t‘ne 
various  aspects  of  crew  interaction. 

Results 

Figure  1  depicts  a  positive  correlation  between  ICEVG  Perfbnviance  Ranking 
cind  LDIE/MOST  ranking  (r  »  .835,  o  <  .05). 
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Figure  I.  LINE/MDST  Scxare  versus  ICEVG  Performance  Rank 


This  result  identifies  a  relationship  bet’ween  performance  and  the 
IiII'JE/mOST  Worksheet  CFvM  assessment  tool  .  Table  1  shows  significant 
correlations  netween  individual  iluy£/'(*jo5T  itaies  and  tix:  total  LINE/HDoT  sooie. 
Review  and  analysis  of  the  transcripts  centered  on  LINE/MQST  Worksheet  items 
w^iich  correlated  strongly  with  total  LINE/^MOST  score.  These  elanents  setaraed 
infLuent^uil  in  iprorovtxi  CRM  perforxaance  ar«3  indicate  catogorias  of  intei-pi-ona 
exclianges  whirdi  would  most  Likely  concain  evidence  ooixieming  aspects  of  SA. 
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USE/FC6T  ScxxH  versus  I»iivicU»l  LINE/MDST  ItitsRe 


ssiaxis 

At, 

Inquiry  practiced - 

.81* 

5. 

Advocacy  practiced. 

,75* 

Ii3. 

Distracticxis  avoided  or  priortized. 

.91** 

11. 

Workload  distributed  and  ccnmuiiGated. 

.86* 

17. 

Ccoflict  resolution. 

.91** 

*  £  <  .05  **  £  <  .01 

Discussion 

Bolroan  (1979)  refers  to  SA,  as  the  crew's  Theory  of  the  Situation.  He 
highlights  tvto  skills  ithicb  influence  the  probability  that  a  crew  will  detect 
and  revise  a  faulty  theory:  (1)  a  Theory  of  Practice  vtiidi  builds  in  inquiry 
and  tasting  in  anotaalous  situauions,  and  (2)  abilities  of  crewsiembers  to 
cccobihe  skills  in  advocacy  and  im^iry.  Although  they  are  not  the  variables 
with  the  strongest  correlation  to  overall  LIKE/MOST  scores,  instances  of 
inquiry  and  advocacy  in  the  mission  transcripts  readily  lend  themselves  to 
analysis. 


It  is  useful  to  think  of  advocacy  as  any  instance  in  vhich  a  creMaattoer 
endorses  a  particular  course  of  action.  A  crewmember  denxxi^  crates  inquiry 
vtoaievar  he  realizes  that  infoBmaUxxi  is  lacking  or  that  incoogruencias  exist 
in  the  crew' s  Theory  of  the  Situation  and  he  conveys  this  uncertainty  via 
question  car  statsssant.  In  this  scenario,  the  ninfeer  of  turns  required  in  the 
route  dharacterizad  N  to  P  transnissiona ;  the  anount,  tyi>e  anA  location  of 
threats  constrained  £  to  P  exchar<ges;  and  how  well  the  pilot  reraenbered  and 
carried  out  these  directicrts  inflioencad  his  conaaun icatiooa  with  M  and  E.  An 
analysis  of  the  context  in  which  2idvocacy  euid  inquiry  occurred  yielded  the 
following  specific  behavioral  recqaaendationa  to  enhance  CSM  skills.  Ihe 
isSPlications  for  the  cxxitent  of  an  SA  definition  follow  each  reocnroendation. 


-  Reap  craw  advised  of  position- specific  infonsatiogi.  Soae  information 
is  available  to  only  one  crew  masher/positicn.  In  the  crews  tliat  performed 
best,  individuals  made  their  infionaation  base  available  to  the  entire  crew. 
The  P/C  should  keep  the  crew  advised  of  pertinent  flight  parameters;  the  R/N 
should  tronsait  the  relationship  of  the  aircraft  to  the  terrairj?  and  the  E/g 
should  verbalise  the  aircraft's  relationship  to  ground/airbome  throats. 
Scxoetime^  craw  moabers  take  easily  accessible  infomation  for  granted.  Vhen 
each  oienttcr  tries  to  convey  a  cogplete  picture  of  his  understanding  of  the 
situation,  the  entire  crew  benefits.  It  ao*sKS  that  the  more  successful  crews 
had  a  greater  quantity  of  interphone  Information  aveiilatale  for  processing. 

Qorollarios 


“  Lister,  for  interphone  tranamiasions  pertinent  to  job  performance. 

—  If  infonsation  essential  to  perfoxmiinco  isn't  available,  eisk  for  it. 

•—  Maintain  interoom  discipline,  i.e.,  don't  interrupt  other  tranamis^^icwis. 
Situational  Awareneos  Inplications ;  Tne  pilot  roxiat  be  aware  of  the 
airtaraift'o  vector  in  tlie  three-dimensional  volume  of  air  (i.e.,  heading, 

altitude,  auta  axx'SpOdd)  ,  tuc  lOCatXOfi.  Ol  Hvls  VeccC-t  wXtli  xeepeCL  Lo  ilie 

terrain  ever  time  (i.e.,  navigation),  anl  the  aircraft's  relationship  to  any 
<i>stact.2  which  might  affect  his  ability  to  aviats  ar*i  achieve  the  mission's 
goal  (i.e.f  air/groind  thr^ts,  weather,  equipi^it  malforKrtion,  etc.).  Crew 
inadoers  mast  be  aware  of  this  inforraation  to  tha  extent  that  they  must  use 
it  to  perfect  their  duties. 
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Coo^i-r»  iaformat-ion  if  poaaib.le?  challenge  if  doubtful.  This 
r-aoafgnendatioo  is  similar  to  inquiry  and  aivcx^acy,  but  it  goes  evsn  further  by 
requiring  an  increased  level  of  ccHifidence.  By  oorroborating  ca:  questiondng 
interpbcoe  traaiantisaioos;  the  creitf  either  validates  and  reinforces  inform ticn 
or  focuses  atr^ntioa  on  reassessnent. 

Oorpllaries 

Vertaiiaa  confirmations  and  challaiges.  A  "thuabs-rp"  or  shoulder 
ihrug  lijnitjs  infonaation  disaanlnation  and  precludes  scrutiny 
other  crev  manbers . 

—  Besolve  oonflicts. 


Situational  Awareness  Inplicationa;  Vfrien  information  incongruities  exist 
(i.el,  c^fiicting  crew  ingtbeirire(3!mraBndat ions  or  instruaent  indications) - 
interpret  than  as  clues  that  SA  might  be  incoiFolete . 


“  Provide  iaforaation  to  increase  the  range  of  options;  be  irlexiblfc. 
Ihe  pilot  must  process  and  act  ipon  an  extrqnely  large  amount  of  information 
in  a  minimal  amoimt  of  time.  Sometimes  he  must  ccBibine  interpiiuna  .'nfcaaatxtioii 
with  hnowlet^  that  tas  just  become  available  to  Idm.  Advocating  at  i  utickioj 
tc  only  one  course  of  action  needlessly  limits  the  possible  solut-lons  to  a 
problan.  Due  to  the  rapidly  changing  nature  inherent  in  aviaiion  taslfs.- 
providing  information  to  increase  flexibility  might  precludi-*  needless 
questioning  if  the  sitmtion  verrants  an  iiacaediate  change  in  tactic:.t/etrategy. 
Oorollary 

—  Caatanicate  all  pertinent  information  and  a  confidence  level  if 
possible.  Even  if  erring  on  the  safe  aide,  tilterirg  or  int^'peeting 
distorts  inforraaticxi. 

Situational  Awareness  Implications;  SA  is  an  extremely  dynamic 
understanding  of  oe^Iex  ralatiookhlpB. 

-  aMtre  vKjrkload  %d.thin  oockpit/etacion.  Sametimea  crew  menbers  queried 
each  other  because  they  were  just  too  busy  to  pay  attention  to  the  interphone. 
Ihe  information  was  available,  but  not  perceived  and/or  understood.  The  good 
crews  managed  to  minimize  these  extraneous  transmissions  by  sharing  the 
workload  betsas^  the  tMO  individuals  at  each  positicxi.  Vigilance  studies  have 
showi  that  hunan  beings  are  not  proficient  monitors.  Including  crew  moebers 
in  the  task  not  only  keeps  them  "in  the  loop",  it  also  frees  hjuids/ resources 
to  devote  to  other  tasks.  Although  it  seems  advisable  for  all  stations  to 
share  the  load,  it's  almost  imperative  that  the  P  relinquish  some 
responsibilities  to  the  C  in  order  to  acccxnplish  the  primary  task: 
ittnintaining  aircraft  control. 

Oorpllaries 

—  Use  all  et^pment/ resources  available  (i.e.,  autqpilot,  etc.). 

—  Do  yxir  job  wall  first,  but  try  to  help  others  do  their  job  IF  your 
workload  permits. 

Situatioc^  Awaraiess  In^ixaiticyts:  There  are  limits  to  human  information 
processing  capabilities.  Predict  periods  of  high  workload,  plan 
accordingly,  and  anticipate  consequences  of  actions. 


Conclusion 
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A^[)ects  of  Workload  Fear  Military  and 
Qvilian  Dtcisnnmakers 


EUiotE-Ectm 
ALPHATIECH,  Inc, 


Abstract 


Weights  ascribed  to  three  workload  dimoisims  of  a  ta^  thou^t  up  in 
abstracdoQ  by  civilian  decisionmakers  as  part  of  the  seals  building  phase  of  die 
Subjective  Workload  Assessment  Technique  (SWAT)  were  not  congn^  with 
wdgto  they  assigned  to  the  dimensions  when  pcxfesming  adecisioamaking  task. 

This  incongruency  was  not  found  fer  iiaHtan;~expgienced  subjects.  The  findings 
may  indicate  a  flaw  in  the  scale  buildieg  procedure  of  the  SWAT. 

Recently  stress  has  become  an  ioqicmnt  topic  fixr  pr^uemers  and  researchers. 
Various  unionunate  eveius  azooztd  the  globe  have  pointedly  indicaad  that  stress  can  have  a 
marked  ic:q>aa  on  human  pexfoimance,  and  often  this  effect  is  seriously  deleterious.  In 
ma^  instances  the  ptima^  stressors  were  identified  as  woridoad  related.  Thatis. 
individuals  were  in  sitnadmis  «diere  dun  were  too  many  tasks  to  con^iete,  there  was 
iasuffiaent  time  available  to  complete  the  required  tasks,  or  the  menial  effort  needed  to 
pesfemn  the  leq^iired  tasks  was  ve^  high.  These  events  have,  in  turn,  evoked  a  renewed 
uueiest  amimg  researchers  in  finding  a  way  to  chaxactcdzc  and  assess  workload. 

Unfortunately,  no  universally  acceptsd  defimrion,  characterization,  or  assessment 
of  workload  cxiss  ^ysaght  et  aL.  1989).  Ihese  researchers  note  that  workload  definitions 
ate  often  discussed  in  the  flawing  three  broad  catego^:  amount  of  work  and  number  of 
things  to  do,  titne  and  dte  particular  aspect  td*  time  OQC  is  concerxied  with,  arui  the  subjective 
psydx^gk^  ejqpeiiences  of  ^  human  opoator.  Of  these,  we  am  particulariy  intenste^ 
m  die  subjeedve  psychological  characttrizatiop  in  oor  examination  c£  stness  ai>d  wcakload. 
That  is.  we  wish  to  focus  on  die  individual’s  subjective  internal  experience  when 
perfanrdngapanicnlarta^  A  staiepxnt  by  Jonanssen  et  aL  (1979)  sums  op  our  positioQ 
well.  If  the  person  feels  loaded  and  effortfiil,  he  is  loaded  and  efiot^  wluuever 
behavioral  performance  measures  show"  (p.105).  We  mo  believe  workload  must  be 
a.ssessed  subjecth’ely.  To  this  end  we  have  ez^iloyt^  the  workload  assesmiem  method 
devised  by  Reid  et  al  (1981)  called  the  Subjeedve  Workload  Assessment  Technique 
(SWAT), 


The  SWAT  specifically  diaracterizes  workload  according  to  three  dimensions:  time 
constraints,  task  con^kxity,  and  psychological  stress.  The  assessment  process  involves 
two  distuux  phases.  Phase  one  is  carried  out  prior  to  data  collection.  Eai^  participant 
pexfoims  a  ^  as  a  precur^  to  development  of  a  workload  scale.  Each  card  contains 

psycix^ogical  stress.  In  turn,  each  workload  dimension  is  described  in  terms  of  Arte 
ievds:  low,  moderate,  and  hl^  Thus,  'uudcipai^  sort  a  set  of  27  cards  (3  levels  of  time 
X  3  levels  oi  mental  efiort  x  3  levels  of  psychological  sacss)  so  that  the  cards  axe  rank- 
ordered  according  to  the  level  of  workload  described.  Tlu!  rank-ordering  is  then  subjected 
m  conjoint  measuiemeni  artalysis  to  detensine  the  relative  weights  of  each  dimension  and  to 
CSt$blisb  a  scale  yninue  to  each  iruJividuaL 


The  instructions  m  the  participants  specifically  indicate  that  they  should  think  of  a 
generic  task  while  doing  the  son  and  weight  the  workload  descriptors  on  a  as  to 
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the  aiQc»m  of  workload  imposes  for  a  task.  (Obvioosly,  there  is  no  way  of 
Icnowing  what  kind  of  task  each  person  has  conjnred  up  in  his  m^). 

The  sectmd  phase  occurs  during  data  cdlecnon.  At  the  end  of  a  job,  trial,  or 
ggpoimcnal  condidon,  participants  rate  the  workload  they  just  expeiienf^  according  to 
the  three  dimensions  of  time,  mental  effort,  and  psychobgical  saress.  Ratings  axe  done  cn 
a  thiec'point  scale  (low,  moderate,  and  hi^)  for  each  dimension.  (Note,  in  this  cose 
subjects  axe  ranng  their  wmkload  experience  ica  a  specific  coaciete  ta^)  Using  software 
provided  by  Reid  ct  aL  (1981),  each  SWAT  scar  "  Lich  consists  of  one  nunber  fiom 
each  of  the  HimftnaAiK  (e.g.,  l,  2, 2),  is  converted  to  a  percent  workload  score  on  the 
participants  unique  scale.  Zero  percent  represents  very  low  workload,  while  1(X)  percent 
rejnesents  very  hi^  workload. 

Overall,  the  scale  has  shown  good  reliability  and  several  indications  as  to  the 
SWATs  validity  have  appeared  in  the  literature  (Lysaght  et  aL,  1989).  In  our  work  we 
have  used  SWAT  almost  exclusively  to  assess  subjects'  woddo^  experience  pezfinming 
rii»rigtnmnalciT>g  anH  rfty^minafinn  In  soore  instances  wc  have  omiced  die  card  son 
and  scale  buihfing  phase  and  devised  a  rating  scale  based  simply  on  the  three  dimoisionc 
(sec  MacMillan  ct  al.,  1987  aib  Entin  ct  aL,  1988).  This  procedure  yielded  vety  acceptable 
results  and  started  us  wotuieringabouttheefficacy  and  importance  of  the  card  sort  and 
crmjoint  mcasuronent  scale  budding  aspects  of  die  SWAT.  We  detea  an  apparent 
weakness  in  the  SWAT  and  this  weakni^  is  highlighted  in  the  parenthetical  expression  in 
the  above  SWAT  desaipdon.  Subjects  are  ask  to  pesfoim  the  card  sort  thinking  about 
some  generic  task  and  workload  in  an  abstraction.  Who  knows  what  kind  of  generic  task 
subjects  coijure  up  or  what  repertoire  of  tasks  are  immediately  available  to  th^?  In  such 
an  abstraction  sui^ects  could  kx^  at  two  card  descriptions  (e.g.,  card  one:  high  time  load, 
tiioderm  mental  <^cm,  moderate  stress  load  and  card  tv-o:  moderate  titoc  load,  moderate 
mental  effort,  high  stress  load)  and  for  the  particular  task  they  have  in  mind  be  voy 
sensitive  to  stress  but  relatively  insensiiivc  to  tiine  and  thus  rank  card  one  much  lower  in 
workload  than  card  two.  Had  they  thought  of  some  oher  task,  die  rankings  could  have 
been  reversed.  The  task  dieyoicountcr  during  an  experiment  or  work  period  may  be 
difTerent  stilL  and  oigender  yet  anoher  set  of  rankings. 

Qeaiiy,  phase  one  of  SWAT  attempts  to  derive  the  subjea's  generic  feelings  about 
the  diree  workload  dimensiai  to  establish  a  woridoad  scale  that  uniquely  describes  the 
sidijecfs  perceptions.  It  appears,  however,  that  the  SWAT  methodology  may  be  flawed. 
To  the  test  diis  we  derived  a  woridoad  scale  for  each  of  our  subjects  employing  the 
methodology  spelled  out  in  ph^  one  of  SWAT.  We  then  con^pared  the  weighting  of  the 
woridoad  dciiv^  in  this  manner  to  th^  weight  derived  firom  a  regression 

analysis  of  the  subjects'  workload  rating  for  a  specific  i^tary-oiiented  dedaonmaking 
task.  We  expected  to  find  substantial  differences  in  the  two  sets  of  weights,  because  we 
expeoed  few  s^ibjects  to  have  experience  with  such  a  task.  We  then  looked  at  the  same 
compaiisoos  fer  a  sample  of  military  subjects  who  have  some  experience  with  the  specific 
decisioiimaldQg  task.  We  expected  a  mu^  higher  congmence  between  the  phase  one 
SWAT  weights  and  those  derived  fiom  the  regression  analysis.  Finally,  wc  ewnpared  the 
woridoad  ratings  of  the  two  samples  on  the  dedskmmaking  task  aooss  a  number  of 
experimental  conditions.  We  er^ected  the  training  and  experience  of  the  military  subjects 
to  lead  them  to  perceive  worido^  differently  than  the  civilian  decisionmakers. 


McLhod 


Qvennew  of  the  Experimental  Decisionmaking  Paradigm 

The  expcriraencai  research  paradigm  is  a  modification  of  the  team  optimal  stopping 
with  communication  alternatives  paradigm  (developed  by  ALPHATECH)  and  is  an 
abstraction  of  an  antisubmarine  vWare  (ASW)  detection  problem.  The  subject,  assuming 
the  role  of  an  ASW  commander,  was  required  to  decide  if  a  detection  was  a  hosnle  or 
friendly  submarine.  The  decision  was  based  on  the  pump  noise  signature  of  the  detected 
submarine.  Decisionmakers  knew  that  die  fiicndly  submarine's  pump  noise  signature  was 
always  370  Hz.  The  hostile  submarine  had  a  pump  noise  signature  of  330  Hz  and  on  other 
occasions  a  signan^  of  360  Hz  Dedsioninakers  also  knew  that  the  detection  sensors  bad 
an  inherent  error  distribution  with  a  standard  deviation  of  20  Hz.  To  aid  in  the 
diseriminatioD  d«.isionmakeis  could  probe  (task  their  sensors  for  another  mcas4ncment)  or 
ask  the  opinion  of  a  knowledgeable  consultant  Information  requests  always  incurred  a 
cost  Stress  was  induced  by  imposing  a  specific  deadline  (tiinc  pressure)  and  requiring  the 
decisionmakers  to  attend  to  an  intrusive  secondary  task.  Tbe  four  within  subjects  factors: 
stress  (low,  high),  discriminabiiity  (easy,  hard),  information  cost  (cost  of  probe  less  than, 
equal  to,  or  greater  than  consultant),  and  consultant  expenise  (equal  to,  greater  than 
I  were  nested  within  two  different  samples:  milit^  and  civilian. 


Subjects 

The  civilian  sample  consisted  of  nine  volunteers  from  an  engineering  firm  or  a 
college  while  the  military  sample  consisted  of  seven  officers  drawn  from  the  ranks  of 
instructor  or  student  at  the  Naval  War  College  in  Newport.  Rhode  Island. 

Fioccduis 

At  the  conclusion  of  each  treatment  trial  subjects  completed  a  SWAT  form.  Thus  a 
rating  for  each  of  die  three  workload  dimensions  (dme  load,  rtKntai  effort,  and  stress)  was 
produced  for  each  treatment  condition.  In  addition  to  the  percent  workload  SWAT  score 
computed  for  each  subjea  based  on  his  unique  scale,  a  score  was  a'so  computed  for  each 
of  the  woridcad  dimensions  based  on  the  raw  rating  subjects  gave  at  the  conclusion  of  each 
treatment  trial  It  was  these  laner  scores  that  were  subjected  to  the  regression  analysis. 

Results 

The  weights  for  the  three  workload  dimensions  derived  from  the  card  son  and 
conjoint  measurement  anaiy^  of  phase  one  of  the  SWAT  were  compared  for  the  two 
samples.  As  expected,  civilians  and  miiiiary  subjects  did  not  weight  the  workload 
dimensions  the  same  way.  Seventy-five  percent  of  the  civilians  saw  stress  as  the  most 
important  determinant  of  workload  while  only  29  percent  of  the  military  sample  saw  stress 
as  most  importanL  Time  load  was  the  modal  choice  of  the  nuliiary  sample  with  43  percent 
seeing  this  dimension  as  the  principle  determinant  of  workload.  Wc  surmise  that  the 
training  and  experience  of  the  luilirary  subjects  has  taught  them  how  to  cope  with  stress, 
thus,  they  sec  stress  as  a  less  important  determinant  of  workload  than  the  cri’dians  da 
Timing,  however,  is  continually  emphasized  as  a  crucial  factor  in  mili',ar>'  opciations  and 
rhi*:  contributed  to  the  military  sample's  sensitivity  to  t.hc  iinpottance  of  rime  loAd, 

To  determine  how  the  two  samples  weighted  the  three  workload  dimensrons  in 
response  to  the  ASW  discrimination  task,  a  score  was  derived  for  each  dimension  based  on 
the  raw  ratings  coUcacd  at  the  conclusion  of  each  treatment  nial.  The  three  dimension 
scores  served  as  the  dependent  variables  in  a  stepwise  muidple  regression  analysis  to 
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the  overall  woridoad  sccrc  (also  computed  from  the  raw  ratings).  For  civilians, 
mental  effot  was  the  first  variable  entered  into  the  regression  equation  to  predict  overaii 
woddoad  score  and  it  accoonied  for  70  percent  of  the  loal  variance.  The  next  variable 
eatogd  was  crag  load,  which  accounted  far  an  addltionai  1 8  perceit  of  the  variance. 
J^ycitJ^gical  stress  only  accounted  far  12  percent  of  total  variance.  As  wc  predicted,  the 
wei^us  amibi^TO  Xbe  woridoad  dimensiocs  of  a  task  conjured  in  abstractioa  by 
dvilkn  dedsionmaktgs  did  not  match  the  weights  asdgeed  when  confronted  with  a 
ctnKretededsfatBnaktngtask.  In  die  abstract,  the  civilian  sample  denoted  psychologjcat 
stress  as  dte  most  in^Kxtant  deteminant  of  wenidoad,  but  when  wcuking  on  the  concrete 
ASW  discnmisacon  task  u  was  mental  effort  that  proved  to  be  the  primaiy  predictor  of 
woridoad.  The  outcome  of  the  regression  analysis  far  the  military  sample  natched  what 
drey  had  stated  in  the  ab^ract  Tim  is.  time  load  was  the  firs:  variable  loaded  into  the 
rcgcessitsi  equation  and  it  accounted  far  58  percent  of  the  variance.  This  was  followed  by 
efiod,  whidi  conitibuted  another  22  pement  to  the  predicted  variance.  The  militaiy  sample 
stOl  dififared  facmi  dte  dvilkns  on  w^  was  the  iDost  irc^Kutant  determinant  of  wmkload, 
and  appeared  to  be  better  calibrated  on  the  weights  of  the  woridoad  dimensions  than  the 
civilians.  We  amilHite  this  calibration  to  their  military  gaining  and  experience. 


'ViTthio-subjects  muldvatiate  analyses  of  variance  were  computed  to  examine  the 
e&os  or  the  independent  variables  nest^  within  high  ard  bw  stress  conditions.  As 
ei^ected,  b<Hh  samples  u^uited  higher  workload  in  the  high  faan  low  stress  situations. 
Tbk  is  a  idnd  of  manipulatitm  check  that  the  stress  induction  of  nme  pressure  and  the 
necessity  to  pafanxn  an  intnjsive  secondary  taskefid  in  fact  produce  bgher  workload. 
Moreover,  rsults  also  showed  that  the  civilians  r^certed  significantly  higher  workload 
rah^  th^  the  ahlitary  personnel  in  bcdi  low  and  high  stress  condition^  As  predicted, 
nulicoy  dedsbninakers can  cope  widi  stress  better  than  the  dviliaxu. 


Hgtn  1  shows  that  dvilians  report  higher  workloads  in  the  difficult  than  eas>' 
discriminaxicn  conditions  for  both  high  (ji<008)  and  low  (£<-003)  stress  situahoos,  while 
zKisocbdiffiTencesexistfordeixhlic^sainpie.  Apparently  the  training  and  experience 
e^yed  by  the  military  persoi^  tends  to  level  out  the  difference  between  the  easy  and 
difficult  discriininarion  condidons  ana  thus  they  do  not  peicdve  the  workload  to  be  greater 
in  the  difficult  discrimination  condiden. 


Hgurc  1 :  Woridoad  as  a  Function  of  Discriminabiliry  for  Low 
artd  High  Stress  Condidons 


Discussion 

Our  results  indicate  that  the  scale  buddir'g  procedures  of  SW.AT  may  be  flawed. 
The  weights  ascribed  to  the  three  woridoad  dimensions  of  a  uisk  conjured  up  in  abstracdon 
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by  tbft  cwfliato  dedstoniijafcesES  vat  noi  congnicnt  with  the  weights  diey  assigned  to  the 
danensiesas  vdiraipeifcaBamg  the  ASW  decisionroaking  task.  The  difficulty  arises  when 
sjdsjects  a®  asi»d  »  perform  the  card  son,  but  aic  tujt  given  an  appropnatc  “ttoget  task”  to 
use.  T3ius,  tia^  perfonn  the  card  raxjking  for  some  abstract  task  they  foink  up.  It  is  very 
liltely  foatfois  absxm  ta^  has  litde  in  conunon  wifo  actual  task  they  will  peifoim,  leading 
stfojects  to  charactenze  wtnkload  in  the  card  son  and  in  the  pezfonnance  ta^  quite 

The  results  also  dtowed  that  if  subjects'  trainir^  and  experience  lead  diem  to  think 
taidits  si  miliar  to  the  one  to  be  perfumed,  as  was  the  case  wifo  the  military  sample,  a 
much  tugfaer  agreement  will  exist  between  the  weights  derived  from  the  card  sort  and  those 
applkd  tc.  die  performance  task.  This  explains  why  past  use  of  the  SWAT,  as  reported  in 
tte  literature,  has  met  with  good  success.  The  subjects  employed  in  most  erf  the  studies 
(see  Lysagtu  ct  an,  1989)  were  highly  trained  (e.g.,  test  pilots,  military  personnel)  waging 
with  tasks  well  known  to  diem  (e.g.,  cockpit  d^gn,  simulated  air-to-air  combat). 

W  s  think  the  scale  buil^g  procedure  of  the  SWAT  is  an  interesting  concept  Our 
quarter  is  Wxth  one  aspect  of  the  proodure.  We  recommend  that  subjects  be  given  the 
dcscripc^oa  of  a  “target  task"  that  is  similar  to  the  task  they  will  be  performing  to  refer  to 
while  ptdonning  die  card  sort  The  workload  scales  derived  for  the  subjects  will  now  be 
a|^iropiiai£  for  the  actual  task  performed. 

We  have  one  further  cautionary  note.  'Ihc  findings  showed  that  the  way  dvilm 
and  military  decisionmakers  peredved  task  workload  was  different  If  researchers  wish  to 
study  the  workload  proclivities  of  miliiaiy  dedaonmakers,  these  results  argue  that  mihiary- 
experienced  personnel  should  serve  as  subjects. 
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Abstract 

Even  with  extensive  research  ard.  develcpsent  of  a  riyriad  of 
assessment  techniques,  there  are  still  a  nunher  of  unsettled  and 
unanswered  issues  regarding  the  concept  and  neasurssent  of 
workload.  *ihis  paper  discusses  the  relaticnship  between 
perforsanoe  and  worSdoad  and  examines  various  dynamic,  V2dJ.ditY, 
2U)d  diagnostic  issues  of  wcodcload. 


The  Operator  Workload  (CttL)  Ptegran  is  a  just-ocupleted,  basic  and  applied 
research  ef&nrt  censored  by  the  Arm/  Research  Institute  (ARI) .  Ibe  OWL 
PSognea  directed  to  establish  guidance  for  the  assessment  of  operator 
workload  with  the  operation  of  Arns/  sysbans.  Ihrou^xxit  the 

octiduct  of  the  program,  various  general  wcn^load  issues  have  surfaced.  We  are 
not  the  first  to  recognize  saas  of  these  issues,  but  feel  this  is  an  apprep* 
riate  venue  in  which  to  organize  and  eaq>ress  our  thou^ts  zuid  those  of  otters. 

The  Perfomanoe  Envelope 

When  eval\iating  current  or  proposed  systescs,  isnalysts  may  be  aisked  to 
determine  \ihether  task  dmands  exxed  the  capability  of  the  operators,  or  in 
other  wemds,  vhethar  workload  levels  will  surpass  the  "red  line".  Seven  (1989) 
eaqxressed  the  need  fear  sene  criterion  to  determine  vhat  oonstirutes  a  "full 
load",  particularly  if  workload  measures  are  to  indicate  the  "proportion 
loaded".  Some  wor^oad  techniques  are  based  on  such  an  absolute  estimation 
approach.  These  measures  may  define  ^»cific  values,  through  their  respective 
algorithas,  as  the  points  above  vtiich  the  operator  is  (overloaded  and 
degradation  of  perfomanoe  will  be  e^diibited. 

However,  Hart  (1S39)  points  out  that  while  increases  in  syrsbem  (ctanplexity 
ctnd  mission  requirements  say  result  in  unreasorably  high  (iesnands  the 
(Operators,  automatiixi  in  seme  systems  may  actually  reduce  workload.  In  fact, 
decrecoents  in  perfomance  may  be  evidenced  as  a  result  of  boredom  and 
(xoplaoency.  Therefore,  it  is  isportant  not  only  to  determine  the  level  of 
workload  wlaich  is  excessively  high,  but  also  to  define  the  range  of  (Optimal  or 
excessively  low  levels  of  vxurkload. 

It  is  proposed  that  husan  perforaanoe  is  not  best  (ccy>o^?tual  ized  as  the 
mercury  which  rises  and  falls  with  task  demands  and  measured  by  a  wcsrkload 
thermometer,  but  rather  that  human  perfomanoe  be  (xnsidered  in  terms  of  a 
laaltidlimensionaL  performance  envelope  (based  on  Lysaght  et  al. ,  1989) .  In  the 


^^^The  'authors  wish  to  ackrKx.'i/,'dge  Allan  L.  ZaXlad  and  his  staff  at  Analy'tics  for 
their  oeyitributions  to  the  CWL  Progran  eind  this  paper.  The  views,  opinions, 
and  findings  contained  in  this  paper  are  those  of  the  authors  and  should  net  be 
ocanstxued  as  an  official  Eteparteient  of  Arsy  position,  policy-  or  decision. 


contract  of  a  envelope,  the  "red  line'*  tb^  beccgaes  an  cuter 

botrdary  beycarid  \iiich  performnoe  is  either  unacceptable  or  unatt2iinable.  Ihis 
inffiiKfesi  situations  in  task  demands  exceed  the  operator's  capability  to 

perfcoaa  effectively  and  situations  in  tdiich  task  danands  are  so  rainimal  that 
perfomance  laay  be  at  risk  to  boredca  and  inattention.  Within  the  boundary 
are  a  oorttinuum  of  zones.  Zones  nearest  the  boundary  represent  those 
situatiods  for  lAuch  perfomanoe  is  nonentarily  acceptable  but  is  in  danger  of 
becoming  unaooqptable  ^lould  certain  everks  occur  (e.g. ,  emergencies) .  Ihe 
core  of  the  envelope  contains  the  wsrkload  ocrofort  zone,  \Aiere  task  demands  are 
sufficient  to  maintain  edertness  yet  do  not  exert  undue  pressure. 

Ihese  boundaries  and  zones  are  not  static,  but  axe  responsive  to  various 
internal  aixl  external  debermirants.  These  include  factors  of  job  requiranents 
and  constraints  as  \tfell  as  the  huistn's  capacities  and  resources.  Aspects  of 
tftsse  dstermiroaits  oontribute  to  the  variability  that  is  found  in  vrorkload 
measureoent.  The  determinants  may  differ  frcn  cperatco:  to  operator,  from  day 
to  day,  and  even  fxcm  imnmpftt  to  mcoent.  Perhaps  more  importantly,  these 
determinants  may  interact.  Perfcrmanoe  can  thus  be  described  as  a  manentary 
point  in  ^aoe  and  time  within  the  pcrfonaanoe  envelope.  The  proximity  of  the 
individual's  position  to  the  boundaries  of  the  envelope  is  indicative  of  the 
operator's  relative  capacity  to  respond. 

Performance  and  Workload 

various  performance  measures  have  been  xised  to  assess  operator  vrorkloeui. 
Seven  (1989)  pxtposes  that  realistic  measures  of  workload  are  those  unobtrusive 
mBasures  %4ucfa  are  ^jocific  to  the  operational  system.  These  real-time 
measures  might  include  neglected  noncritioal  tasks  (e.g.,  proportion  of  ncn- 
task-relevant  massages  in  air  defense  systems) .  Resulting  i^’stan  performance 
has  also  been  used  as  an  indication  of  workload  (e.g. ,  number  of  targets 
successfully  engztged) .  Kowever,  mary  performance  measures  reflect 
characteristics  of  the  environment  or  the  system  and  provide  little  informaticai 
about  the  effort  c^oerted  to  achieve  that  performance. 

Hart  (1989)  points  out  there  is  a  difference  between  measuring  performance 
and  the  asacunt  of  effort  expeided  to  perform  the  task.  Operatcrs  may  be  able 
to  exert  the  extra  effort  and  allocate  the  additional  rescurces  required  to 
maintain  system  performance  i:-:  the  face  of  increasing  task  demands.  Hcwever, 
operators  may  apply  sene  extra  effort  but  still  be  unable  to  meet  demands, 
resulting  in  system  performance  degradaticn.  Additionally,  eperators  may  elect 
to  maintain  a  consistent  level  of  effort  in  the  faoe  of  Increasing  task 
demands,  also  resulting  in  decreases  in  system  performance.  Finally,  operators 
may  attenpt  to  achieve  acceptable,  rather  thzin  perfect  levels  of 

pei^onoance. 


It  is  poesible  that  relationships  between  performance  and  workload 
moasuretr  occur  only  at  vt^rkload  extremes  (very  hic^,  as  well  as  very  Icxv) .  It 
may  also  be  that  workload  scores  are  mcare  highly  correlated  with  perforroance 
for  teisks  vhich  are  critical  to  system  perfomanoe  (e.g. ,  acqLiisition  and 
uriotkiiig  uoSkS  IJri  alx'  uefei'iSe  systems) .  rtuL’  oCXiie  axtuaticns,  TCi  rclatlOn5iU.p 
between  workload  arti  perfornonce  may  be  found  and,  in  fact,  instances  of  hi^ 
woricload  were  found  to  result  in  better  performance  (e.g. ,  Yeh  and  Wickens, 
1988) .  However,  to  ocnclude  that  there  is  no  change  in  workload  or  that  a 
particular  workload  measure  is  not  valid  if  there  is  no  aocoitpanying  chairge  in 
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perfonnanoe,  is  an  erronecxis  cxaxilusion  airi  runs  ocrtorary  to  occraon  sense. 

Cynamic  Adjects 

Human  performance  has  been  described  as  a  mccentary  point  in  space  and 
time  and  -us  a  functicsn  of  rany  variables.  However,  hunan  behavior  and  workload 
are  both  dynasnic.  Vtoidcload  may  be  cxxisidered  frcn  the  standpoint  of  the  effort 
required  for  only  the  csurzent  task  or  tasks  being  aoocnplisl^  at  a  particular 
mdaent  in  time.  Manentaxy  workload,  in  this  ocntext,  dspencte  not  only  cai  the 
task  to  be  aooopplished,  but  also  the  current  resouroes  of  the  operator  to 
perfom  the  task.  It  my  be  that  task  performanoe  is  more  d^>endent  on  the 
accuBUlated  workload  at  various  points  in  time  on  the  mcraentary  demands  of 
the  task.  For  exanyle,  idie  probability  of  an  error  my  be  more  related  to 
accumulated  wodcload  than  to  moiaentaxy  workload,  dirxent  remaining  workload  is 
ocBfxrised  of  the  totad.  eagsocted  efforts  required  to  ocoplete  all  currently 
assigned  tasks. 

It  is  likely  that  operators  adept  strategies  for  responding  to  workload. 

In  seme  situations,  operators  my  reschedule  or  shed  tasks  sc  that  current 
reoaining  workload  is  unread  out  more  evenly  over  a  period  of  time.  In  :3ane 
cases,  the  operator  must  be  able  to  make  a  rapid  transition  from  a  low 
workload  state  to  a  hi^  woikload  state.  Along  with  this  transition  the 
operator  my  adept  alternative  strategies  for  the  increased  workload  (e.g, 
oonoentrating  on  hi^  priority  tasks) .  Response  strategies  are  probably  as 
dynamic  as  td^  changes  in  workload.  However,  if  hi^  workload  continues  for  ein 
extended  period  of  time,  the  operator's  resouroes  my  becrane  depleted  resulting 
in  inadequate  performanoe.  Even  ext^ided  periods  of  low  workload,  acxxxtpaxuad 
eporadlcally  with  sharp  transitions  to  hi^  workload  my  diminish  the  physical 
and  m^ttal  resouroes  of  operators. 

Teoporal  variables  may  have  sigxdf leant  influences  on  the  workloesd 
experienced  and  on  the  results  obtained  from  the  scales  designed  to  measure  it. 
For  exaaple,  operators  who  are  asked  to  rate  their  overall  workload  frexa  the 
beginning  of  a  mission  until  the  present  time  my  be  utilizing  either  an 
averaging  method  or  an  additive  interpretation  of  workload.  Workload  peaks  my 
have  a  significant  effect  on  workload  ratings  (see  lavecxhia,  1989,  for  a 
discussion  of  this  issue) .  VJhai  obtaining  workload  informticn  prospectively 
or  retixa^sectively,  the  operator  or  SHE  can  be  seen  as  a  sounoe  of  knavledge 
that  my  be  elicited  thrxju^  a  structured  formt  (e.g. ,  via  a  workload  rating 
scale) .  Whan  operators  give  workload  ratings  while  "on  the  job"  tl^y  can  be 
seen  as  'Hrerkload  meters"  that  sirply  read  out  a  load  level  (Vidulich,  1989) . 

Validity 

Workload  measures  virich  vary  in  relationship  to  the  manipulated  levels  of 
task  difficulty  (e.g. ,  orders  of  control  for  tracking  taslcs)  are  said  to  have 
desnonstratad  face  validity.  It  also  has  been  argued  tliat  operator  ratings  are 
the  most  valid  measure  of  workload,  regardless  of  performanoe  levels.  "If  tlie 
person  feels  loaded  and  effortful,  he  i§  loaded  and  effortful  whatever  the 
b^rar/ioral  «nd  performajnoe  maasumes  show”  {Jebanssen  et  ad.  ,  1979,  p.  105).  In 
ocniraiTt,  Wickens  (1989)  states  that  "the  ultimte  design  criterion’ should  be 
satisfactory  performnoe  rather  than  adequate  subjective  opinion"  and  that  it 
is  the  former  that  should  be  used  for  validation  of  workload  measures  (p.  271) . 
And  BO  the  dabate  continues. 
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As  has  been  psneviously  iUustcated,  \1x3rkload  is  a  functicsi  of  laany 
variables,  of  task  difficulty  is  only  cue.  Siixse  different  types  of 

aaasures  are  liJoely  to  be  related  to  differeait  system  or  oission  variables,  it 
is  su^grestfid  that  a  battery  of  operator  uodcload  meaisures  win  chtain  the  most 
data.  T^ig  is  particularly  Irnpcgtant  in  a  field  test  situaticn  vd^ere  it 
is  imperative  to  glean  every  acvailable  bit  of  infonnaticn  possible,  validity 
in  the  field  is  often  a  **patciariork*'  of  bits  of  information,  loost  seaningful  in 
their  totality,  liiis  2pproach  esplcys  the  saethcxi  of  converging  operations,  a 
diagnostic  methodology  for  attaddng  a  problea  in  several  differ^  ways  to 
insure  ^le  quality  of  the  inference. 

The  validity  of  a  workload  assessment  stxr^  is  also  related  to  the  realism 
and  fidelity  of  the  test  situation.  Vkaddoad  aaaasures  obtained  in  early  field 
tests,  in  wtdoh  many  aspects  of  realistic  battlefield  situations  are  absent, 
nest  likely  underestimate  the  workload  that  would  occur  under  isore  realistic 
conditions.  Therefore,  ary  workload  IssueCs)  identified  in  these  studies 
would  be  indicators  of  more  severe  problems  in  situations  in  which  failure  has 
more  severe  oonsaquenoes.  The  general  trend  is  toward  utilizing  more 
sophisticated  technologies  to  deliver  Increasingly  realistic  enviroraosTts. 

With  increasing  oost  of  such  technologies,  it  is  Important  to  screen  the 
eaperimental  varitdoles  to  find  out  %hich  axe  res^ms^Uole  for  sihstantial 
pca±ions  of  the  response  variance  and  hold  less  readily  manipulated  variables 
constant  (Rasooe,  1980). 

Diagixsticity 

The  essence  of  the  diagnostic  process  Is  to  identify  the  specific 
mechanism  or  pcooess  involved  during  the  performance  of  a  partiojlar  task. 
Therefore,  the  diagnostic  capabilities  of  any  of  the  workload  technl^ies  n;st 
rely  on  a  thorough  task  analysis.  The  result  of  the  analysis  is  an  operator 
activity  profile  as  a  function  of  mission  time  and  segment,  essentially  a  time- 
based  aralysis  of  performance  requirements.  Without  such  detail,  a  workload 
analysis  can  only  identify  general  problem  areas  leaving  the  determination  of 
the  cause(s)  of  the  workload  to  guesswazk. 

It  is  isportant  to  note  that  the  diagnosticity  of  workload  techniques  lies 
in  their  ability  to  pinpoint  the  souroes  of  wcricload,  which  is  not  to  be 
oenfused  with  the  identification  of  the  causes  of  workload.  For  example,  the 
CWL  Pcogram  found  that  for  the  IfS-F-H  air  defense  system  identifying  rotary¬ 
wing  aircraft  was  rated  higher  in  workload  than  for  fixed-wing  aircraft.  The 
source  of  workload  is  a  mission  variable  —  the  fact  that  it  is  a  rotary-wing 
is  nert  the  cause.  The  cause  of  the  hi^ier  wczklcad  may  be  that  the  display 
does  net  clearly  depict  rctary-ving  craft,  that  the  urpredictable  nature  of 
Epical  rotary-wing  flight  paths  (e.g. ,  pop-ip)  makes  initial  sitting  of  the 
target  difficult,  or  other  facto;  .  Identifiration  of  the  souroe  of  wcsrkload 
is  an  iaportant  st^  towards  disocTvering  the  cause  of  a  potentied  or 
demonstrated  performance  problem.  However,  it  is  the  determinaticn  of  the 
cause  \Alch  provides  the  necessary  infarmaticn  for  st^s  to  be  taken  to  reduce 
workload  (e.g. ,  throuch  changes  in  hunan  engineering  design,  training} . 

Sunsoary 

Hart  (1989)  points  out  that  much  confusion  has  surrounded  the  term, 
workload,  because  it  has  been  used  a  label  for  the  stimulus  or  crause  (i.e. , 


deaands),  the  le^scnse  or  the  canaeq^iesrce  (i.e,,  effects  of 
.:^i^:^^teSBax^-aR  qpaatore)  and  as  an  intervening  variable  to  expledn  the 
between  ta^  damnds  and  perfisrsanoe.  She  believes  that  these 

^  MtJe«t  of  vxarkLoad  have  contributed  oonsiderable  ocnfusion 
ani  appar^^  inoonsistent  results  to  the  study  of  wsrklcad. 


XVen  in  this  short  treatise  addre^djig  varidoad  issues,  the  unemswored 
<iaa6tions,  corifllcting  results,  and  o(:paslng  viewpoints  illustrate  this 
prtijleBi  of  watddoad  d^inition.  Ibose  that  question  the  validi^  of 
fsu^active”  ratings  for  assessing  iiradcload  are  defining  woddoad  in  teroas  of 
the  tai^  demands.  She  virtues  of  operator  ratings  eu%  e3q>:xinded  by  those 
eqctate  wcdckload  with  effort  estpended.  If  workload  is  viewed  as  the  ’'cause'*, 
then  perfonnanoe  is  die  "effect”  and  a  aonotonic  relation^ilp  between  the  two 
varii^leB  is  e>qpected.  AssuBptions  of  ocxisistently  hi^  siotlvatian  states  of 
hnsin  operators  Bey  detour  researchers  away  £coa  studying  alternative  viraddoad 
stratogW.  Ihe  research  and  ocnclusions  drawn  about  ^oddoad  are  clearly 
influenoed  by  the  researcher's  oonceptualization  of  the  tern. 
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Abstract 

Twelve  Bradley  qualified  crews  were  tested  in  SIMNET-T 
Bradley  Fighting  Vehicle  (BFV)  siauiators  under  varying  levels  of 
speech  intelligibility.  Their  navigation  perfontance  over  20 
short  (1.5  to  2  kiloaeter)  course  exercises  was  ateasured.  The 
auaber  of  exercises  successfully  conpleted  and  the  nuaber  of  check 
points  reached  within  each  exercise  decreased  as  soeech  clarity 
was  degraded. 

Co— uni  cation  is  a  factor  whose  ii^ortance  is  acknowledged  in  all 
environ— nts  requiring  infor—tion  transfer.  McCormick  (1976)  has  described 
the  type  of  — ssage  which  is  best  conveyed  using  auditory  co— onication: 

The  —ssage  is  simple,  short,  will  not  be  referred  to  lat-r,  deals 
with  events  in  ti— ,  and  calls  for  immediate  action  (p.  A3>. 

All  these  characteristics  hold  for  the  coassunication  of  infonsation 
during  a  military  operation,  which  is  run  off  in  real  ti—  axid  requires 
auditory  communication  if  it  is  to  be  executed  properly.  In  many  large 
vehicles  (including  most  military  track  vehicles),  auditory  co— unication 
among  the  various  members  of  the  crew  is  critical  just  to  allow  navigation  to 
reach  a  military  objective. 

An  esperi— nt  was  conducted  using  the  SINNET-T  facility  to  test  the 
effects  of  degraded  auditory  com— nication  on  navigation  tasks. 

Method 

Exercise  scenarios  were  developed  to  test  Bradley  Fighting  Vehicle  (BFV) 
crews  on  both  navigation  and  gunnery  exercises.  The  navigation  task  consisted 
of  a  point-to-point  route  finding  exercise.  The  Bradley  Commander  (BC)  called 
each  designated  check  point  along  the  route  in  to  the  base  station. 

Thirty-six  Bradley  qualified  soldiers  were  tested  as  12  three-man  crews. 
Each  crew  was  composed  of  a  driver,  a  gunner,  and  a  com— nder.  Crews  usually 
had  not  worked  together  as  BFV  crews  before  this  experiment.  Each  man's  MOS 
qualified  him  for  bis  respective  crew  position.  All  crew  members  were  tested 
and  found  co  nave  an  Hi  nearing  profile. 

A  repeated  measures  experi— ntal  design  was  used.  Each  crew  was  tested 
at  five  levels  of  intelligibility.  A  chopping  circuit  was;  used  to  set  these 
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('i^rox^uttias  lOOXy.  At  eacii  level  of  intelligibility,  each  crew  coepleted 
fair  ^xerelgAA,  E&ch  crew  ww  tested  using  the  MRT  to  detereine  their  actual 
inteUUgibility  level  &t  the  designated  chop  circuit  setting. 

Performance  weasored  using  a  combination  of  time  and  operational 
error  weasttres:  ^iiuccess  or  failure  of  the  mission  (operationally:  "Did  the 
crew  reach  the  release  point  within  10  minutes?");  number  of  check  points 
readhed;  time  to  reach  checkpoints;  and  SWAT  workload  ratings. 

Each  crew  participated  in  one  day  of  training  and  two  days  of  testing. 
Each  crew  trained  on  three  tasks:  Modified  Rhymes  Test  (MET)  calibration. 
Subjective  Workload  Assessment  Technique  (SWAT)  prototype,  and  Simulation 
Network  (SliflCET)  exercises.  Working  as  a  crew,  they  read  the  MRT  until  they 
achieved  9SX  (or  better)  intelligibility  on  three  consecutive  SO  word  tests. 
Ttwy  completed  the  SHAT  prototyping  card  sort.  They  trained  for  two  to  three 
hours  os  the  SIMHEX,  first  doing  point-to-point  navigation  on  a  road  course 
set  tfaa  BattleMaster.  Then  they  completed  two  sample  exercises  of  the  type 
that  were,  to  be  used  in  the  experiment.  Each  crew  completed  as  many 
r^etitiotts  of  these  exercises  as  possible  in  the  time  available. 

Pairs  of  crews  were  tested  together.  Each  crew  completed  four  exercises 
at  each  of  the  five  levels  of  intelligibility.  The  first  level  tested  was 
always  a  moderate  one.  The  remaining  four  levels  were  counterbalanced  for 
order.  Each  intelligibility  level  required  approximately  a  one- and-a- half 
(1-1/2)  hour  session  to  coa^lete.  In  this  time,  each  crew  completed  an 
initial  tffiT  to  obtain  a  pre-test  measure  of  actual  intelligibility.  Each  crew 
then  colQ^leted  the  four  exercises.  At  the  end  of  the  session,  they  completed 
a  post-test  MET. 

la  this  experiment,  eight  separate  courses  were  set.  By  starting  at 
each  end  of  ttie  course,  16  courses  were  created.  Each  exercise  began  at  a 
Start  Point,  ran  thr<rafh  three  specified  checkpoints,  and  ended  at  a  Release 
Point.  For  an  exercise,  the  two  crews  began  at  opposite  ends  of  a  single 
course.  The  total  length  of  the  coarse  was  1.5  to  2.0  kilometers.  Crews  were 
allowed  five  minutes  to  reach  the  first  checkpoint  and  10  minutes  to  reach  the 
release  point. 


Results 

Although  attempts  were  made  to  insure  that  each  crew  completed  exercises 
at  each  level  of  intelligibility,  for  some,  crews  intelligibility  could  not  be 
dropped  to  the  lowest  levels  due  to  difficulty  with  the  communication  system. 
Therefore,  more  exercises  were  run  at  the  higher  levels  of  intelligibility. 

To  determine  the  actual  level  of  intelligibility  for  a  session,  the  crew's 
pre-test  and  post-test  MRT  scores  were  averaged.  This  average  intelligibility 
was  used  to  classify  an  exercise  session  into  the  following  five  ranges:  (0  to 
9X;  10  to  34X;  35  to  64X;  65  to  R9Z;  and  90  to  100X).  The  means  o£  these  five 
ranges  were  1.9X,  27. 8X,  51. IX,  12.1%,  and  96. OX.  Respectively,  36,  36,  68, 

48,  and  52  exercises  were  run  at  these  five  levels  of  actual  intelligibility. 

Kavigaticnal  accuracy  and  course  completion  time  as  well  as  SHAT  ratings 
are  presented  in  this  paper. 


'  total  distance  to  be  traveled  was  less  than  tvo  kiloneters.  On  87 

of  the  240  exercises  (36X),  the  crews  reached  the  Release  Point.  For  slightly 
iKire  {96  or  40X)  of  the  exercises,  the  experiaenters  stopped  the  crew  becaiise 
10  «intttes  had  passed.  For  41  (17X)  of  the  exercises,  the  crew  ended  the 
tesaioii.  Usually  this  occurred  in  the  lowest  intelligibility  condition, 
because  the  co— nnder  was  cot  able  to  coaeunicate  with  his  driver. 

Intelligibility  level  influenced  the  nuatber  of  exercises  in  which  a  crew 
reached  the  release  point.  This  effect  W2ts  roughly  linear,  raising  froe 
apprCEXiantely  10X  success  rate  at  the  lowest  intelligibility  level  to  60X  at 
the  highest.  See  Table  1,  Percent  RP,  for  acre  exact  values. 

On  exercises  which  ctnded  successfully  (i.c. ,  the  crew  reached  the 
release  point),  the  aean  hiae  did  not  differ  systeaatically  with  the 
intelligibility  level  (see  Table  1,  Mean  Latency).  This  latency  value  is 
included  for  coapleteness.  It  is  difficult  to  interpret  because  latencies 
were  available  only  for  exercises  on  which  the  RP  was  reached.  More  crews 
were  able  to  coaplete  aore  exercises  as  intelligibility  improved.  Hot  all 
crews  exhibited  the  saae  level  of  skill.  More  expert  crews  were  soaetiiM  able 
to  reach  'tiie  RP  even  ntider  poor  coannication  conditions;  therefore,  the 
latencies  of  less  expert  crews  were  not  included  in  the  mean  latencies  at  low 
intelligibility,  but  were  included  at  higher  levels  of  intelligibility. 


Table  1.  Percentage  of  exercises  which  ended  successfully  at  the  Relesise 
Point  (Percent  RP)  are  listed  as  a  function  of  intelligibility  level  (InteIX). 
The  mean  latencies  for  these  successful  trials  are  also  listed. 


InteIX 

Percent  1 

1.9 

11 

27,8 

25 

51.1 

35 

72.7 

42 

96.0 

61 

Mean  Latency  (sec) 

487 

416 

483 

486 

408 


In  each  exercise,  the  crews  traveled  a  fixed  route,  stopping  at  three 
checkpoints  prior  to  reaching  the  release  point  (RP).  The  nuaber  of  exercises 
for  which  crews  actually  reached  each  checkpoint  increased  with  intelligi¬ 
bility  level.  The  percent  exercises  for  which  each  checkpoint  was  reached  are 
shown  in  Table  2.  However,  the  amount  of  time  required  to  reach  a  checkpoint 
did  not  differ  systeaatically  with  intelligibility.  (Note  that  the  tine  to 
arrive  is  only  for  those  exercises  on  which  the  checkpoint  was  reached.  That 
is,  success  on  reaching  the  check  point  serves  as  a  gate  for  measuring  the 
tiae  variable. ) 


Crews  rated  their  mental  workload  using  the  SWAT  scale.  This  measure 
consists  of  three  subscales  to  measure  mental  effort,  time  pressure,  and 
stress.  Each  subscalc  allows  low  (1),  medium  (2),  and  high  (3)  ratings. 
Therefore,  the  minimum  soiMBed  SWAT  rating  is  3.0  and  the  maximum  is  9.0. 
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TaMe  2.  Percent  of  etxercises  on  which  each  checkpoint  was  reached.  Data  are 
-"i  '  "  table4  as  «  function  of  Intelligibility  level. 

Intelligibility  Level  (X) 


Check 

1.9 

27.8 

51.1 

72.7 

96.0 

Point 

1 

17 

56 

66 

83 

75 

2 

11 

33 

54 

58 

75 

3 

11 

25 

44 

56 

71 

RP 

11 

25 

35 

42 

61 

In  an  earlier  study  of  tank  crews,  SKAT  ratings  have  proven  to  be  a 
leading  indicator  of  task  difficulty  when  intelligibility  levels  were  varied 
(Whitaker,  Peters,  &  Garinther,  1989).  In  the  current  study,  crews  were  asked 
to  provide  SWAT  ratings  2Lfter  each  exercise  and  after  each  MET  list. 

SWAT  ratings  can  be  analyzed  in  two  ways.  By  using  a  conjoint 
aeasuresient  technique  developed  by  Nygren  (1982),  the  ratings  can  be 
transforaed  to  interval  data.  These  interval  data  may  be  reported  as  a 
general  scale  for  the  entire  staple,  or  nay  be  subdivided  to  be  specific  to 
each  of  the  SWAT  subscales.  Alternatively.  SWAT  scores  can  be  reported  as 
untransforaed  ratings  for  each  subscale  or  for  the  sub  of  the  subscale  scores. 
Whitaker,  Oataan,  and  Shank  (1988)  and  Biers  (1987)  have  reported  high 
correlations  between  the  transforacd;  data  and  the  rating  sua  data. 


After  both  the  Pre-session  (Pre-tesl)  MRTs  and  the  Post-session  (Post¬ 
test)  MRTs,  SWAT  ratings  were  obtained  froa  each  crew  aeaber.  Crew  neabers 
were  asked  to  rate  how  difficult  it  was  to  do  the  listening  part  of  the  MET. 
These  ratings  were  tabulated  for  each  SWAT  subscale  (tine,  effort,  and 
stress).  These  ratings  were  suaaed  to  obtain  a  Sua  SWAT  rating,  which  are 
listed  in  Table  3  as  average  crew  ratings  at  each  intelligibility  level. 

These  ratings  indicate  th&t  the  crews  reported  a  decrease  in  difficulty  as  the 
intelligibility  iaproved  froa  1.9X  to  96X. 

After  each  exercise  in  the  session,  each  crew  aeaber  provided  a  SWAT 
rating  of  the  difficulty  of  the  exercise.  Task  workload  (Sua  SWAT  ratings) 
decreased  as  intelligibility  iaproved.  The  crew's  Sua  SWAT  ratings  are  also 
listed  in  Table  3. 


Table  3:  Average 

crew  Sua  SWAT 

ratings  by  Intelligibility 

level . 

MET 

MET 

Pre-Test 

Post-Test 

Exercise 

IntelX 

SWAT  Sub 

SWAT  Sua 

SW/JT  Sua 

1.9 

7.1 

7.5 

6.8 

27.8 

5.9 

5.8 

5.9 

51.1 

4.8 

4.5 

4.3 

72.7 

4.4 

4.4 

4.  1 

96.0 

3.1 

3.0 

3.9 
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Discussicm 


TSie  foUcwins  coccXusicns  are  based  o&  the  descriptive  data  from  this 
sao^ie.  There  have  been  no  statistical  tests  conducted  on  these  data  to  allow 
iofereoces  to  the  population  of  BFV  crews. 

These  results  are  consistent  with  the  hypothesis  that  military.'- 
effectiveness  is  adversely  affected  by  degraded  cooaiuaication.  Crews  were 
less  likely  to  coa^lete  the  mission  successfully  when  speech  intelligibility 
is  degraded.  They  were  less  likely  to  complete  each  phase  line  of  the 
Mission.  Based  upon  the  results  of  this  study,  SWAT  was  shown  to  be  a 
sensitive  Measure  of  subjective  workload  for  these  Military  exercises. 

The  Mean  latencies  were  calculated  across  all  crews.  These  did  not 
differ  as  a  function  of  intelligibility;  however,  the  interpretation  of  this 
latency  Measure  is  difficult  because  it  was  obtained  froa  different  crews  at 
different  intelligibility  levels.  For  exaaplc,  only  one  crew  was  able  to 
coMplete  exercises  at  the  1.9X  intelligibility  level.  However,  11  crews 
cOMpleted  soMe  exercises  at  the  96X  intelligibility  level.  Crew  by  crew 
examination  of  the  latencies  does  show  large  individual  differences;  however, 
analysis  of  the  crew  by  crew  latency  data  would  net  seen  to  provide  very 
meaningful  interpretation  because  of  the  missixig  data  (i.e.,  intelligibility 
levels  at  which  a  crew  did  not  ever  reach  the  release  point  successfully. ) 

Further  research  is  planned  to  study  the  effects  of  intelligibility  on 
military  performance.  One  area  of  interest  is  the  use  of  coamunication 
difficulty  as  an  index  of  training  proficiency.  For  the  current  study,  all 
crew  Members  were  Bradley^qualified  in  their  MOS,  yet  crews  differed  widely  in 
their  performance  under  conditions  of  degraded  communication.  More  skilled, 
better  trained,  and  more  proficient  crews  nay  continue  to  perform  well  under 
degraded  communication  conditions.  An  index  of  performance  level  in  simulated 
battle  conditions  under  varying  conditions  of  auditory  workload  would  provide 
a  valuable  tool  to  assess  training  and  skill  levels. 

References 

Biers,  D. ,  &  Hasline,  P.  (1987).  Alternative  approaches  to  analyzing  SWAT 
data.  Proceedings  cf  the  Mid-Central  Ergonomics/Human  Factors  Society. 
Urbana-Champaign,  II. 

McCormick.  E.  J.  (1976).  Human  factors  in  engineering  and  design.  McGraw- 
Hill:  New  York. 

Nygren,  T.  £,  (1982).  Conjoint  measurement,  and  conjoint  scaling:  A  user's 

guide.  AFAMRL-TR-82-22.  Wright  Paterson  APB,  OH, 

Whitaker,  L.  A.,  Oatman,  L.  C.,  &  Shank,  M.  D.  (1987).  Measuring  mental 
workload:  A  performance  battery.  HEL  Technical  Report  (TM  21-87).  HD: 
Aberdeen  Proving  Ground. 

Whitaker,  L.  A.,  Peters,  L. ,  &  Garinther,  G.  (1989).  Tank  crew  performance: 
Effects  of  speech  intelligibility  on  target  acquisition  and  subjective 
workload  assessment.  Proceedings  of  the  Human  Factors  Society  32nd  Annual 
Meeting. 


L  ^  -  New  ZeiaXaiui  Military  Family  Values 

Edna  J.  Hunter,  Ph^D. 

United  States  International  University 
Carol  Jaman 

Hew  Zealand  Defence  Psychology  Unit 
Abstract 

During  the  1088-198S  Pulbright  award  cycle,  a  landmark 
study  of  Hew  Zealand  military  families  was  conducted  by  this 
writer  while  serving  as  a  Senior  Scholar  under  a  6-Biontb 
NZ-US  Educational  Foundation  grant.  The  purpose  of  the  study 
was  to  explore  major  issues/problei&B  of  HZ  military  families 
and  make  recommendations  to  the  NZ  Ministry  of  Defence,  based 
on  the  findings.  The  focus  of  this  p>aper  is  the  differences 
which  exist  between  NZ  military  family  value  orientations  and 
families  within  the  American  military  system. 

Although  much  has  been  written  on  military  families  in  the 
United  States  (Hunter,  1982),  almost  no  research  has  been 
undertaken  in  New  Zealand  (NZ).  This  report  will  address  some  of 
the  findings  concerning  basic  NZ  military  family  value 
orientations,  axui  compare  them  to  what  has  previously  been  foiwd 
for  American  military  families. 

Method 

The  1988  New  Zealand  Military  Family  Study  (Hunter,  1989}  was 
the  first  major  study  ever  conducted  of  that  particular 
population.  This  writer  was  invited  by  the  NZ  Secretary  of 
Defence  in  1986  to  carry  out  such  a  study.  It  was  Jointly 
sponsored  by  the  NZ->US  Educational  Foundation  (Fulbright  Program) 
and  the  NZ  Ministry  of  Defence,  under  the  aegis  of  the  NZ  Defence 
Psychology  Unit.  Military  planners  were  primarily  interested  in 
obtaining  recosimendations  for  changes  or  additions  in  policy  and 
programs  which  could  perhaps  alleviate  family  stresses  and  thus 
make  for  higher  quality  of  life  for  NZ  military  families.  The 
present  report  will  not  focus  on  those  recommendations.  Rather, 
it  focuses  on  only  a  small  portion  of  the  larger  study, 
specif ioslly  NZ  military  family  value  orientations.  Participants 
included  spouses  (legal  and  reoognized  de  facto)  of  all  personnel 
serving  in  the  NZ  Armed  Forcen  in  1988  (Army,  Navy,  and  Air 
Force).  The  study  was  bipartite:  (1)  a  mailed  paper  euid  x>encil 
survey,  and  (2)  personal  interviews  with  a  small  representative 
sample  of  the  total  population  of  spouses.  Participation  was 
voluntary . 


*  The  authors  extend  special  thanks  to  LCOL  Janet  Turner  and 
MAJ  Alan  McCone  for  their  assistance  with  the  project.  The 
views  expressed  in  this  report  ere  those  of  the  authors;  erd 
do  not  necessarily  reflect  those  of  sponsoring  organizations. 


A  total  of  2772  spouses  returned  the  aiailed  questionnaire,  a 
51.25i  return  rate.  Personal  interviews  were  conducted  at  military 
locations  throvulhout  Hew  Zealand  with  153  of  the  spouses  who  had 
previously  completed  the  mailed  survey.  All  interviews  were 
taped.  For  the  most  part*  selection  of  interviewees  was  random, 
although  an  attempt  was  made  to  match,  by  group,  the  total 
population  of  military  families  with  respect  to  age,  working 
versus  non-working  spouses,  and  presence  or  absence  of  children. 
Results  from  the  mailed  survey  are  discussed  elsewhere  (Hunter, 
1S89).  This  report  focuses  only  on  results  from  the  2-hour  semi- 
structured  interviews.  A  small  comparison  group  (N  =  29)  of 
civilian  N2  spouses  was  also  selected.  The  two  NZ  subsamples  of 
families  (153  military,  29  civilian)  were  well-matched  with 
respect  to  age  range,  presence  or  absence  of  children,  employed 
versus  non-eraployed,  and  percent  male  spouses.  As  part  of  the 
interview  protocol,  each  interviewee  was  asked  to  complete  a 
standardized  instrument  which  prov'idea  a  profile  of  the  relative 
importance  of  tea  family  values  or  orientations,  the  Family 
Environment  Scale  (Moos  &  Moos,  1986).  The  value  orientations 
measured  by  the  Scale  include:  Cohesion,  Expressiveness, 

Conflict,  Independence,  Achievement  Orientation,  Inter-Cultural 
Orientation,  Active-Recreational  Orientation,  Moral-Religious 
Emphasis,  Organization,  and  Control. 

Findings 

Within  the  group  of  153  spouses  who  were  interviewed,  27.5% 
were  spouses  of  Officer  personnel  and  72.5%  were  of  Other  Ranks 
(comparable  to  U.S.  enlisted  and  non-commissioned  officers).  Most 
were  wives  (95.1%);  4.9%  were  husbands  of  military  women.  Their 
ages  ranged  from  21  to  58  years  of  age,  with  a  mean  of  31.1  years 
(S.D.  =  6.2).  Slightly  over  twelve  percent  (12.1%)  were  dual 
military  couples  (compared  to  9.3%  in  the  survey  sample).  Out  of 
that  twelve  percent,  5.0%  were  Army,  4.3%  Air  Force,  2.1%  Navy, 
and  .7%  Territorials  (Reserves).  As  to  service  affiliation,  45.8% 
of  those  spouses  interviewed  were  Army  spouses,  38.0%  Air  Force, 
and  15.5%  Navy  spouses.  Over  sixty  percent  (62.0%)  were  employed 
outside  the  home,  and  over  eighty  percent  (82.9%)  had  children. 
Both  the  survey  sample  and  the  interview  sample  were  fairly 
representative  of  the  total  population  of  married  service 
personnel  in  the  NZ  Forces,  except  for  two  minor  differences.  A 
larger  percent  of  the  interview  sample  had  children,  compared 
with  the  survey  sample.  Also,  dual  military  couples  were 
intentionally  over-ssuapled  in  the  interviewing  in  order  to  obtain 
as  much  information  as  possible  about  that  important  subsample  of 
military  families. 

Findings  from  the  Interviews 

Only  small  portions  of  the  data  from  the  interviews  are 
presented  in  this  paper.  Additional  findings  will  be  presented  at 
a  later  time.  At  some  point  during  each  interview,  interviewees 
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“were  witax  tiie  ”beBt“  thing  about  aiiitary  life  waa,  and 

whbt  VfBte  the  “worst"?  Aa  -for  the  "beat",  they  listed  (1) 
flnanoial  security,  (2)  social  life,  (3)  the  unique  lifestyle 
with  opportunities  for  travel,  (4}  affordable  housing,  axui  ^5) 
the  fact  that  their  military  spouses  enjoyed  it.  In  response  to 
the  question  concerning  the  "worst"  aspect  of  the  military 
lifestyle,  they  mentioned  {!)  family  separations,  (2)  mobility, 
{3>  lack  of  information,  (4)  poor  housing,  and  (5)  lack  of 
privacy.  They  were  also  questioned  as  to  what  changes  or 
additions  they  would  like  to  see  made  to  make  military  family 
life  more  satisfying  or  less  stressful.  Among  the  most  frequently 
listed  cbanges/additiona ,  in  descending  order  of  frequency  of 
mention  were:  (1)  more  information  available  to  family  members, 
(2)  spousal  input  regarding  future  postings  of  the  military 
member,  (3)  more  family-related  activities,  (4)  better 
communications  between  the  military  spouse  and  the  family  during 
separations  due  to  military  duties,  (5)  better  communication 
channels  between  the  family  and  the  military  unit,  (6)  longer 
postings,  and  (7>  confirmed  transportation  benefits  for  family 
members . 

Soorea  on  the  Family  Environment  Scales 

Between-group  comparisons  for  FES  Subscale  scox^s  were  made 
between  (1)  NZ  military  spouses  and  NZ  civilian  spouses;  (2)  NZ 
military  and  American  military;  and  (3)  FES  Norma  and  both  S2 
military  and  American  military.  The  FES  gives  a  profile  of  the 
family's  orientation  or  emphasis  placed  on  various  values  by 
family  members.  There  is  no  overall  score,  but  rather  a  profile 
for  the  individual  on  the  10  Subaeales. 


N2  Military  versus  NZ  Civilian  Families  on  the  FES.  Comparing  NZ 
military  spouses  with  NZ  civilian  spouses,  it  was  found  that 
there  were  a  number  of  statistically  significant  between-group 
differences  on  the  FES  Subscales.  NZ  military  spouses  scored 
significantly  higher  on  Achievement  Orientation  and  Control,  and 
lower  on  Cohesion  and  Independence,  compared  to  NZ  civilian 
spouses.  There  were  no  statistically  significant  differences 
between  the  groups  for  the  other  Subsoales.  A  number  of 
comparisons  for  family  environment  for  NZ  families  in  general 
(that  is,  military  and  civilian  groups  combined,  N  =  182)  were 
made  to  determine  differences  between:  (1)  employed  NZ  spouses 
versus  non-emplcyed  spouses;  (2)  younger  versus  old  NZ  spouses; 
and  (3)  NZ  wives  versus  NZ  husbands.  Employed  spouses  differed 
from  ncn-employed  spouses  on  Cohesion  and  Independence,  with  the 
employed  group  scoring  significantly  higher  on  both  (p  <  .01). 
Fesiale  spouses  did  net  differ  significantly  from  husbands  on  any 
of  the  FES  Subscales.  There  were  some  differences  with  respect  to 
age.  The  younger  group  (25  years  and  under)  scored  significantly 
lower  on  FES  Organization  and  Cohesion  (p  <  .01).  Thus  it  appears 
that  as  spouses  grow  older,  they  tend  to  increase  their 
organizational  skills,  along  with  developing  higher  levels  ot 


cohesiaa  wit-hin  the  . 

MZ  Hilitery  veraua  Aiacvican  Milit&x*y  Faailieg*  FES  Scores.  The 
re&der  may  wonder  how  “NZ  military  familiee*  FES  scores  compare 
with  those  of  military  families  in  the  United  States >  Since  the 
FES  has  been  widely  used  in  America,  it  is  possible  to  «ive  a 
tentative  answer  to  this  question c  Contrasting  scores  on  the  FES 
for  the  153  NZ  military  faioilies  in  this  study  with  a  sample  of 
71  AmeriCHn  military  families  (data  from  a  study  by  Nice, 
McDonald,  &  McMillian,  1981),  it  was  foxxnd  that  NZ  military 
family  members  scared  higher  on  Cohesion,  Express iveness , 
Intellectual 'Cultural  Orientation,  Active-Recreational 
Orientation,  and  Organisation,  and  lower  on  Conflict, 
Independence,  Achievement  Orientation,  Moral-Heligicus  Emphasis, 
and  Control ,  with  the  greatest  differences  between  the  two  groups 
on  Control  and  Achievement  Orientation  (NZ  lower  on  both).  No 
statlatioal  teats  of  the  significance  of  these  differences  were 
possible  since  raw  data  for  the  American  sample  were  not 
available. 

NZ  and  American  Military  FES  Scores  veraua  Scale  Norma.  The 
question  also  arises  as  to  how  both  military  groups  (NZ  and 
American)  stack  up  against  FSS  Norms.  When  NZ  military  families’ 
FES  Siibscale  scores  were  compared  with  those  shown  in  the  Scoring 
Mantial  for  the  sample  of  1125  families  used  to  estubllah  Norms 
for  the  FSS,  NZ  military  fauailies  scored  higher  on  Cohesion, 
Expressiveness,  Intellectual-Cultural  Orientation,  Active- 
Secreational  Orientation,  and  Organization,  and  lower  on 
Conflict,  Independence,  Achievement  Orientation,  Moral-Religious 
Emphaaia,  and  Control.  Again,  no  statistical  teste  of 
signiflcauioe  were  possible.  Comparing  the  previously  mentioned 
group  of  *^1  Amerieaux  military  families  (Nice,  McDonald,  fc 
McMillian,  1981)  with  scale  Norms  from  the  Manual,  Americans 
scored  higher  on  Cohesion,  Expressiveness,  Independence, 
Achievement  Orientation,  Active- Recreational  Orientation,  Moral- 
Religious  Emphasis,  and  Control,  and  lower  than  the  norms  on 
Conflict  and  Independence.  American  military  spouses  had  exactly 
the  baae  mean  score  for  Intellectual-Cultural  Orientation  aa  the 
Noz^.  No  tests  ox'  statistical  significance  were  computed. 

Discussion 

In  the  earlier  study  by  Nice  and  associates,  those 
investigators  concluded  that  American  military  families  tend  to 
show  a  "structure-oriented"  profile;  that  is,  they  score  higher 
than  the  Norms  on  Cohesion  and  Organization,  and  lower  on 
Conflict.  Both  NZ  military  and  U.S.  military  families  scored 
higher  than  the  Norms  on  Cohesion,  Exprcasi venose ,  Active- 
Recreational  Orientation  and  Organization,  and  both  scored  lower 
on  Conflict.  Thus,  results  from  the  1988  NZ  Military  family  Study 
corroborate  those  of  Niue  and  colleagues.  Also.  NZ  military 
spouses  showed  higher  scores  than  either  American  military 


^  or  sstandardiaed  Norca  on  Cohesion,  Expressiveness, 

■Acvive'-li;4creatiional  Ch.'ieii'tat.ion,  and  Organization,  and  lower  than 
■either  A&erican  military  families  and  Norms  on  Independence, 
Achievement  Orientation,  Moral-Beligious  Eiiiphasia,  and  Control. 
Ihus,  the  findings  of  this  study  are  fairly  congruent  with  the 
1982  study  by  HcGee  and  8ilva  of  a  group  of  Dunedin  HZ  families 
who  were  coiDpared  with  American  Norms.  These  earlier 
investigators  (McGee  k  Silva,  as  reported  in  Smith,  1988,  p.216) 
found  more  Cohasiveness  and  Expresriveness  and  less  Conflict  in 
NZ  families,  ooape^ed  to  American  families.  They  concluded  that 
NZ  family  relationships  were  more  open  and  supportive  and  leas 
angry  and  aggressive.  American  families,  they  stated,  were  more 
encounuging  of  independence,  more  competitive  and  achievement- 
oriented.  Also,  they  indicated  their  resrlts  showed  that  NZ 
families  "held  ethical  and  religious  beliefs  just  as  strongly  as 
American  familxes."  Interestingly,  in  this  comparisons  made  for 
this  study,  American  military  faallirss  scored  higher  on  Moral- 
Religious  Emphasis  (MRS)  than  either  NZ  military  or  NZ  civilian 
families.  American  military  families  also  scored  higher  than  the 
Nora  for  the  KRE  Subecale .  Therefore  from  these  comparisons,  it 
would  seem  that  although  NZ  favilies  generally  (military  and 
civilian  combined)  score  comparable  to  the  Norms  on  the  MRS, 
neither  group  holds  as  strong  a  moral/religious  orientation  as 
American  military  families.  Otherwise,  the  FES  profiles  for  KZ 
military  and  U.S.  military  families  are  quite  similar. 
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Abstract 


An  ethnographic  natural  history  of  thirty*two  drill 
sergeants  and  their  faailies  throughout  their  two^ear  tour 
has  eaanined  the  interactive  proceaaea  ufaich  exist  eaong  the 
unit,  the  fasdly  end  the  drill  sergeant.  The  degree  of 
stress  on  the  drill  sergeant  and  the  fasuly  is  a  function  of 
the  stability  of  the  faaily  and  the  social  clieate  in  the 
unit.  Faaily  relations  affect  the  quality  of  drill 
sergeants '  perforaance  either  positively  through  support,  or 
negatively  through  distraction.  The  social  cliaate  of  units 
aediates  the  effects  of  the  deaands  of  drill  sergeant  duties 
upon  the  faaily,  and  in  turn.  Mediates  the  resdioess  of  the 
fsaily  to  support  the  drill  sergeant  in  his  or  her  duties. 


This  research  describes  the  interactive  participation  of  drill 
sergeants  in  their  faailies  and  in  their  units*  The  Departaent  of 
Military  Psychiatry  of  the  Halter  Heed  Aray  Institute  of  Hesearch,  under 
the  auspices  of  the  DCSPEH,  has  been  investigating  ways  in  tdiich  aspecta 
of  ailitary  life  facilitate  or  iapede  ailitary  fasdlies*  adjustsumts 
(Rosen  and  Mogbadaa,  1988;  Noghadaa,  1989;  Kirkland  and  Katx,  1988). 
Concurrently,  research  prograas  have  been  underway  to  identify 
Icaderabip  behavior  which  enhances  cohesion  and  iaproves  aission 
perforsHUxee  (cf.  Marlowe,  1985;  Marlowe,  ct.  al.,  1989;  Kirkland,  ct. 
al.,  1987).  In  the  course  of  research  into  adaptation  by  the  faailies 
of  drill  sergeants  it  becaae  apparent  that  soldiers,  their  units,  and 
their  faailies  do  not  function  in  isolation  froa  each  other.  This 
report  describes  soLdicr^aaily-unit  interactions  that  affect  the 
soldier's  aorale,  the  ability  of  the  faaily  to  cope,  and  unit 
perforaance. 


^  The  views  of  the  author  do  not  purport  to  reflect  the  position  of.  the 
Departoent  of  the  Artsy  or  the  Deparunenc  of  Defense. 


Drill  sergeant  duty  ia  believed  by  stany  researchers  to  be  highly 
stressful  (Vemoo,  1986;  FullertoQy  1984).  Many  drill  sergeants  expect 
stress  before  they  begin  their  tour,  have  heard  anecdotal  evidence  that 
marriages  frequently  disintegrate  as  a  result  of  drill  sergeant  duty» 
and  ouny  believe  they  are  stressed  throughout  ssich  of  their  tour  (Katz 
and  Kirklandt  1989).  Although  Vernon  docuaented  soste  of  the  sources  of 
drill  sergeant  stress  in  the  units  and  referred  to  the  deleterious 
effects  of  that  stress  on  the  family  (1986),  no  research  has 
systesiatically  investigated  the  effects  of  drill  sergeant  duty  on 
oiarriage  and  family  life,  nor  the  effects  of  marriage  and  family  life 
upon  drill  sergeant  duty.  Nor,  importantly,  has  research  systematically 
exasuned  the  positive  effects  of  so-called  stressful  duty,  such  as  drill 
sergeant  duty  upon  the  family  or  the  positive  effects  of  the  family  upon 
the  soldier's  stressful  duty. 

Investigation  on  the  causes  and  implications  of  stressful  military 
duties  and  their  interactions  with  the  fasiily  has  suffered  from  the 
social  organisation  of  social  research*  Studies  on  stress  of  military 
personnel  have  usually  restricted  analyses  either  to  a)  psychological 
effects  upon  individual  soldiers,  b)  leadership  or  storale  factors 
impinging  upon  units,  or  c)  family  factors  which  degrade  performance. 
Each  of  these  contributions  to  understanding  the  effects  of  stress  upon 
performance  and  readiness  has  confined  its  understanding  of  stress  to 
the  causal  factors  under  investigation  —  psychological,  small-group  or 
faisily  Each  contribution  has  its  own  body  of  literature  chat  is 
minimslly  shared.  Whereas  many  studies  may  give  lip  service  Co  the  idea 
that  one  factor  may  affect  the  other  —  such  as  Che  unit  may  impinge 
upon  the  vulnerability  of  the  individual  soldier,  only  a  few  have 
focused  upon  the  interactive  effects  of  family  and  duty  (Ciricland  and 
Katz,  1989;  Mogbadam,  1989;  Orthner  and  Pittsmn,  1989). 


Method 


Subjects 


The  data  are  based  upon  an  ethnographic  natural  history  of  thirty- 
two  drill  sergeants'  families  throughout  their  two-year  tour  on  an  US 
Army  Basic  Training  Post.  The  primary  subjects  of  the  study  comprised 
58  infonsants  —  32  drill  sergeants  (including  two  drill  sergeant 
couples)  and  26  (non-drill  sergeant)  spouses.  Eight  of  the  thirty-two 
were  fesule,  two  of  whom  were  single  parents.  Twenty-seven  were  drill 

sergeants  for  Initial  Entry  Training;  three  were  drill  sergeants  for 
Advanced  Individual  Training.  The  demography  of  the  group  of  drill 
sergeants  reflected  the  age,  gender,  ethnicity  and  length  of  service 
cf  tbs  pest's  drill  ssrgeent  populsticn. 
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Procedure 


The  aethodologiee  used  in  this  scody  were  parCicipient*~obaerv«tion 
and  unatructured  open-ended  interviews.  The  aethodclogy  consisted, 
first,  of  recruiting  froa  Drill  Sergeants  School  thirty  drill  sergeants 
with  faadlies  as  reseasrch  volunteers.  Participant  observation  took 
place  in  Drill  Sergeant  School,  on  the  drill  sergeants'  training  units, 
in  the  drill  sergeants'  boaes,  and  in  daily  life  activities  of  the 
spouses.  The  unstructured  open-ended  interviews  took  place  with  each  of 
the  fifty-eight  drill  sergeants  and  spouses  who  were  the  focus  of  the 
study,  and  with  a  saall  sajiqtle  of  drill  sergeant  instructors  at  the 
Drill  Sergeant  School,  the  Cosaand  Sergeant  Major  of  the  Drill  Sergeant 
School,  the  Coanand  Sergeant  Major  of  the  post,  13  KCOs  and  Officers, 
Oiaplains,  and  Officers  in  the  Judge  Advocate  General's  coemand  on  the 
post. 


The  research  included  a  series  of  five  to  six-hour  interviews  with 
the  soldier  and  the  spouse.  Approziaately  four-fifths  of  these 
interviews  were  individual  interviews;  one-fifth  took  place  with 
couples.  The  interviews  were  spaced  throughout  the  drill  sergeants' 
two-year  tours,  with  the  greatest  frequency  at  the  beginning.  The  data 
base  consists  of  935  hours  with  drill  sergeants  and  spouses  in  twenty- 
two  training  coapanies. 


Besults 


Of  the  thirty  drill  sergeant  families,  twenty  adapted  to  the 
deaands  of  drill  sergeant  duty.  Seventeen  of  those  twenty  fassilies  were 
strong  before  drill  sergeant  duty,  and  remained  strong  during  the 
tour.  Three  of  those  families  were  not  strong  before  the  drill  sergeant 
tours,  but  improved  during  the  tour.  Ten  families  did  not  adapt 
successfully  to  the  deaands  of  drill  rergeant  duty.  Seven  of  those  ten 
families  were  strong  before  drill  sergeant  duty,  but  becaam  weaker  or 
deteriorated  daring  the  tour.  Three  of  those  families  were  not  strong 
before  drill  sergeant  duty  and  became  weaker  or  deteriorated  during  the 
tour.  In  four  of  the  families  (three  of  whoa  were  from  the  weakened 
families)  the  drill  sergeants  either  left  the  service  or  were  seriously 
planning  to  leave  the  service  as  a  consequence  of  the  tour  of  duty  as  a 
drill  sergeant;  these  four  bad  an  average  of  12.6  years  of  service. 

Criteria  for  determining  the  strength  of  marriages  was  based  upon 
explicit  assesaamnts  by  the  drill  sergeants  and  spouses,  and  their 
supportive  statements  about  past  and  ongoing  coamunication,  trust, 
sexual  relationa  and  arguawnts*  Spouses  in  strong  surriages  who  had 
satisfactory  social  support  (whether  friends,  Church,  mother  or  husband) 
offered  significant  support  for  tbe  drill  sergeant  in  his/her  unit, 
Both  the  drill  sergeants  and  their  spouses  were  acutely  aware  of  the 
ways  in  which  drill  sergeant  duty  impinged  upon  the  marriage  and  the 
family,  but  they  differed  in  their  responses  to  that  impingement. 


thfc  uaict  subjected  tbe  drill  sergeent*  to  different  cultural 
■environaMSCs  and  tbeir  experiences  and  perceptions  of  the  envlroneents 
in  tlwir  units  affected  t^ir  fanilics.  The  aoldiers*  traasnission  of 
theivr  ettitude^  about  their  units  influenced  the  fani lies’  attitudes  and 
perceptions  about  the  units  The  faailies*  attitudes  and  perceptions 
a^bout  the  unicSf  as  veil  aa  their  internal  dynasties  and  coi— ntucation, 
in  turn*  affected  the  drill  sergeants*  concentration,  dedication,  and 
perfonsance  on  the  job,  and  their  attitudes  toward  trainees. 

A  general  pattern  eaerged  froa  the  ways  drill  sergeants  and  their 
spouses  perceived  the  soldiers'  coapanies.  Coaonencs  by  drill  sergeants 
and  spouses  in  the  fastilies  which  adapted  were  more  likely  to  described 
the  soldiers'  units  as  supportive.  Coaneents  about  units  by  fasulies 
tdtich  deteriorated  during  the  drill  sergeant s'  tours  were  aore  likely  to 
describe  the  soldiers*  units  as  indifferent  toward  the  soldiers  and 
their  fasulies.  Often  the  drill  sergeants'  and  spouses'  perceptions  of 
their  units  changed  over  tiae.  These  changes  proved  aost  often  to  be 
associated  with  changes  in  tbe  key  leaders  —  coanander,  first  sergeant 
or  senior  drill  sergeant* 

The  contribution  of  the  unit  to  the  interactive  process  depended  to 
the  degree  to  which  the  leaders  (coaaander,  executive  officer,  first 
sergeant,  and  senior  drill  sergeant)  integrated  the  three  primary  facets 
of  the  life  of  the  coap/my  —  the  training  recruits,  support  activities, 
intra-'cadre  interactions,  (roster  duties  and  details,  company 
ad^aistration,  taskings  by  higher  headquarters),  and  soldier-family 
activities. 

In  well  integrated  units  the  leaders  recognised  that  all  the  facets 
arc  essential  to  the  efficiency  of  the  company,  and  kept  all  of  thea  in 
mind  when  assigning  priorities,  coasiiinicating  with  the  drill  sergeants, 
and  asnagi  ng  tiae  and  other  resources*  In  a  typical  well-integrated 
company,  the  leaders  cncoursiged  the  drill  sergeants  to  call  their 
faailies  when  there  were  breaks  in  the  schedule,  reduced  manning  to  a 
ainiaiw  for  low-priority  activities  so  that  high  priority  training  would 
have  asTlanm  participation,  and  scheduled  activities  well  in  advance  so 
that  drill  sergeants  and  their  families  could  predict  when  they  could  be 
together  and  aak£  plans.  In  poorly  integrated  units  leaders  insisted  on 
full  aanniog  for  all  activities,  frequently  called  off-duty  drill 
sergeants  back  to  the  company  for  trivial  reasons,  and  continually 
changed  schedules  and  requirements  to  that  fasulies  never  knew  when 
their  drill  sergeants  would  be  home. 


Discussion 


Drill  sergeant  duty  is  emotionally  demanding  and  {diysically 
fatiguing.  Tias:  tfith  fxailieH  i«  The  degree  of  stress  on  tbe 

drill  sergeant  and  the  family  is  a  function  of  the  stability  of  tbe 
family  and  tbe  social  climate  in  the  emit.  An  interactive  process 
exists  between  the  unit,  the  drill  sergeant  and  the  family.  The 
extensive  time  and  emotional  demands  of  drill  sergeant  duty  affect  both 
the  amount  of  time  with  the  family,  and  Che  quality  of  active,  emotional 


part Icipac ion  vith  the  faaiily.  Patt.ily  relations  affect  the  quality  o£ 
drill  sergeants'  perforaance  either  positively  through  supportf  or 
negatively  through  distraction. 

The  social  climate  of  units  mediates  the  effects  of  the  »*eswni1f  cf 
drill  sergeant  duties  upon  the  family,  and  in  turn,  stsdiates  the 
readiness  of  the  family  to  support  the  drill  sergeant  in  his  duties. 
Further  research  will  define  specific  characteristics  of  the  faadlies 
and  the  supports  for  the  spouses  that  enhance  tht  soldiers' 
participation  in  the  unit. 
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Abstract 


Tne  Organizational  Climate  Survey  (OCS)  is  a  management  tool 
v^ich  can  assist  in  identifying  Issues  which  may  affect  the 
prochictivlty,  satisfaction,  and  motivation  of  personnel.  The 
survey  assesses  the  perceptions  of  unit  personnel  on  23  key  factors 
and  provides  a  personnel  perspective  of  how  things  are  goii^  in  the 
unit,  I.e.,  It  surfaces  both  positive  aspects  and  areas  which  may 
require  additional  management  e^>has1s.  Although  It  was  developed 
solely  for  use  by  commanders,  the  OCS  has  great  flexibility  and  its 
use  has  been  extended  into  other  Air  Force  programs.  Most  recently 
the  OCS  was  modified  for  use  as  a  measure  for  two  Air  Force 
programs  -  the  Palace  Coi^te  project  and  Total  Quality  Management. 


The  Organizational  Climate  Survey  (OCS)  was  developed  to  fill  a  need 
expressed  by  commanders  for  a  method  of  acquiring  Information  on  how  their 
organizations  were  functioning.  The  development  process  Involved  hundreds  of 
people  and  all  ranks.  First,  commanders  were  asked  what  Information  about 
their  orgulzatlons  they  thought  was  Important  for  them  to  know.  The  lists  of 
items  were  amsolldated  and  merged  Into  23  factors  (Table  1).  Then  an  Initial 
bank  of  Iteam  that  possibly  relate  to  each  factor  mis  developed  using  several 
resources  and  brainstorming  sessions.  Over  100  people  at  all  management 
levels  Independently  sorted  the  item  pool  and  groups  items  under  the  factor 
they  thought  the  Items  measured.  From  these  groupings  an  initial  survey 
instrument  was  developed  and  pretested  at  Air  Force  bases  in  San  Antonio. 

After  performing  a  factor  analysis,  items  that  were  found  not  to  load  highly 
on  a  factor  were  discarded.  Finally,  the  survey  was  administered  to  over 
6,000  individuals  (military  and  civilian)  across  the  Air  Force  to  establish 
irarms  for  each  factor. 

The  OCS  results  provide  tte  commander  with  a  systematic  assessment  of  the 
perceptions  personnel  have  concerning  their  unit.  The  argument  is  sometimes 
made  that  attitude/opinion  questionnaires  are  not  practical  management  tools 
since  the  data  they  provide  are  people’s  perceptions  and  not  necessarily 
statements  of  fact  or  reality.  While  this  ambiguous  relationship  between 
perceptions  and  reality  does  at  times  exist,  it  does  not  negate  the  fact  that 
what  an  individual  perceives  is  "reality'’  to  that  Individual,  i.e.,  the 
individual  acts  on  his  perceptions  and  organizational  behavior  is  influenced 
by  those  actions.  Thus,  the  perceptions  expressed  through  the  attitudes  and 
opinions  in  the  OCS  provide  valuable  insight  into  perceived  organizational 
reality.  Whether  these  perceptions  arc  confirmed  by  a  reality  check,  they  are 
important  and  need  to  be  addressed  if  the  organization  is  to  remain  (or 
become)  healthy. 
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ISStiK  I 

Factors  Measured  bv  the  OroanizationaT  Climate  Survey 


Sections  1  and  2 

Pay  and  benefits/economic  security 

Commitment 

Promotion  opportunity 

Communication 

Concern  for  individual 

Identification 

Assigiuiant  locality 

Supervision 

Confidence  In  nanageoent 

Recognition 

Working  conditions 

Independence 

Contribution/participation 

Achievement 

Group  cohesion/worker  relations 

Interest 

Organ izaticnal  effectiveness 

Responsibility 

Personal  growth  and  development 

Utilization 

^tions  3  and  4 

Index  of  unit  development 

Job  satisfaction 

(^allty  of  work  life 

Method 


The  OCS  can  be  actailnistered  at  any  organizational  unit  fron  a  squadron, 
division,  or  directorate  to  an  entire  wing.  The  survey  Is  used  with  both 
■llltary  and  civilian  personnel.  Depending  upon  the  size  of  the  unit  anu  the 
way  tSte  data  is  to  be  analyzed,  the  unit  nay  ctKKJSe  to  do  a  sair^le  or  a 
census.  Since  aost  organizations  using  the  OCS  have  a  relatively  small 
population  (less  than  4,000)  using  a  census  for  the  subjects  is  usually 
preferred. 
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The  <XIS  survey  cootains  a  demographics  section,  ^our  standardized 
sections,  and  a  section  reserved  for  organization-specific  items,  Denx^raphics 
collected  are:  rank/grade,  race,  sex,  iwjronautlcal  rating,  and  supervisory 
status^  The  user  nay  collect  further  demographic  data  using  the 
organization-specific  section. 

S^K^tion  I  contains  93  statements  (positive  and  negative)  which  assess  20 
of  the  23  key  factors  which  relate  to  the  quality  of  various  aspects  of  unit 
life.  The  respondent  is  asked  to  agree/diss^rc^  with  each  of  the  statements 
usiffig  a  7-point  Likert  scale,  where  "Strongly  Disagree*  and  "Strongly  Agree" 
are  the  end  points  and  "Neither  Agree  nor  Disagree"  is  the  midpoint. 

In  Section  2  the  emphasis  turns  to  the  importance  the  respondent  gives  to 
each  of  the  20  factors  which  were  rated  for  quality  in  Section  I,  A  7-point 
scale  is  used  with  "Not  At  All  Important*  and  "Extremely  Important"  as  the  end 
points  and  "Moderately  Ii^iortant"  as  the  midpoint. 

Section  3  consists  of  two  separate  measures.  The  first  provides  a  trend 
indicator  for  the  quality  of  the  individual's  work  life.  Using  a  7-rung 
ladder  as  a  scale,  respondents  rate  the  quality  of  their  work  life  between 
“Best"  and  "Norst"  at  three  time  periods:  1  year  ago,  the  present,  and  1  year 
from  now.  The  second  measure  in  this  section  uses  the  same  ladder  scale  and 
asks  the  member  to  rate  his  unit  in  relation  to  other  units  for  the  same  three 
time  periods. 

Section  4  uses  the  4-qaestion  scale  (the  Hoppodc  scale)  as  an  indicator 
of  Job  satisfaction.  Since  these  four  questions  [^tavc  been  used  previously  on 
Air  Force-wide  samples,  the  results  can  be  presented  in  comparison  to  Air 
Force  averages. 

In  the  section  reserved  for  unit-specific  questions  the  user  may  submit 
up  to  10  additional  questions  for  analysis.  Host  organizations  use  this 
section  to  break  out  the  squadrons,  divisions,  or  duty  sections  of 
respondwjts.  They  may  also  ask  questions  relating  to  the  mission  of  various 
elements  of  the  organization,  such  as  perceived  customer  satisfaction  or 
prescription  filling  turn  around  time. 


Pr<w:9<li<rg 


The  Personnel  Survey  Branch  at  the  Air  Force  Military  Personnel  Center 
provides  a  camera-ready  C(^y  of  the  survey  to  the  user  along  with  answer 
sheets  designed  to  be  optically  scanned.  The  using  o:'gartizat1on  then 
administers  the  survey,  collects  the  answer  sheets  and  returns  them  to  the 
Personnel  Survey  Branch  for  scanning  and  standardized  report  output. 


Results 


Survey  results  consist  of  approximately  250  pa^s  of  computer  printout, 
interpretation  and  make  data  readily  available  to  the  user.  The  user  is  also 
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provitieti  the  OCS  User's  Guide  (Silva,  Haailton,  i  termadnik,  1978)  to 
facilitate  understanding  and  presenting  the  data.  The  results  are  divided 
into  eight  reports.  In  every  report  except  Report  2,  the  data  are  reported  by 
the  following  deaographic  breakouts:  total,  officers,  enlisted,  civilians, 
sujwrvision,  race/ethnicity,  and  sex.  Report  2  presents  results  in  tenas  of 
unit  total,  officer  total,  enlisted  total,  and  civilian  total.  Any  subgroup 
with  less  than  5  respondents  is  not  reported. 

Report  1  identifies  the  average  importance  and  quality  for  each  of  the 
twer.ty  factors  measured  by  Sections  1  and  2  of  the  survey.  This  report  also 
cents V ns  a  representation  by  factor  of  the  percentage  of  responses  falling 
below  4,  the  midpoint  of  the  scale,  iihen  at  least  30%  of  the  responses  for  a 
given  factor  fall  below  4,  an  asterisk  apjMsars  next  to  the  quality  mean  for 
that  factor. 

Report  2  focuses  on  key  issues  using  the  individual  items  from  section  1 
of  the  survey.  It  lists  the  10  items  which  have  the  highest  averages  (most 
positive)  and  the  10  items  which  have  the  lowest  averages  (most  negative). 
These  20  specific  items  can  provide  the  user  with  an  additional  perspective  of 
strong  and  weak  points  within  the  organization. 

Report  3  summarizes  the  results  of  the  job  satisfaction  scale.  Scores 
are  broken  down  by  demographic  categories  and  the  Air  Force  average  for  each 
demographic  group. 

Reports  4  and  5  outline  the  results  of  Section  3  of  the  OCS  survey. 

Report  4  provides  a  rating  on  the  quality  of  work  life  over  the  three  time 
periods.  Report  5  indicates  the  relative  position  of  the  unit  from  the  worst 
possible  to  the  best  possible. 

Report  6  provides  detailed  results  for  each  of  the  93  Items  from  the 
first  portion  of  the  survey.  For  each  Item  and  each  demographic  group  the 
percent  answering  each  of  the  7  responses  are  Indicated.  The  items  are 
arranged  by  factor  in  alphabetical  order  so  itwas  that  measure  one  factor  can 
be  viewed  together. 

The  last  two  reports  only  apply  in  smb  instances.  Report  7  presents 
wing  norms  for  organizations  that  are  wing  or  equivalent  level.  The  norms  are 
presented  as  percentile  units  for  each  factor  so  an  individual  unit  can 
co^iare  its  personnel  with  the  total  wing.  Report  8  is  reserved  for 
user-originated  questions.  For  each  question,  the  results  are  presented  by 
deaographic  group  and  percentage  of  response  to  each  alternative  answer. 

In  addition  to  the  average  quality  scores  on  each  of  the  first  20  factors 
presented  in  Section  1,  the  reports  present  Air  Force  norms  for  each  factor. 
These  norms  include  separate  comparative  values  for  (1)  all  Air  Force 
personnel,  (2)  officers  only,  (3)  enlisted  personnel  only,  and  (4)  civilians 
only.  Thus,  a  unit's  average  quality  score  on  any  given  factor  can  be 
coi^itred  to  the  norm  score  for  that  factor.  This  is  an  additio.  j1  input  to 
the  commander  on  the  unit's  relative  strength  or  weakness  in  each  area. 


Discussion 


I1.C  u.*gan'i rational  Climate  Survey  r.as  oesn  usee  succs£stu,.j 
C(winanders  at  all  organizational  levels  for  over  11  years.  Most  indicate  the 
survey  results  are  a  very  useful  tool  in  assessing  the  health  of  their  unit 
and  pinpointing  areas  of  concern.  It  has  been  particularly  useful  to  new 
coaiBanders  who  want  to  get  a  "feel"  for  their  organization.  Because  each  item 
on  the  XS  only  weighs  on  a  single  factor,  it  has  a  modular  design.  This 
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attrT|)ute  leads  a  great  deal  of  flexibility  to  the  OCS  as  it  can  be  customized 
for  use  in  other  projects. 

Recently,  It  has  been  used  in  two  Air  Force  projects.  The  first  project 
is  the  Nlace  Compete  Program,  a  budget  initiative  within  the  civilian 
^rsoimel  consunity  being  tested  at  12  installations.  Palace  Coi^te  gives 
local  supervisors  of  civilian  personnel  control  over  their  civilian  funds;  the 
supervisors  then  determine  how  to  fill  vacant  positions.  The  project  officers 
identified  five  factors  {confidence  in  aanageaent,  group  cohesion/worker 
relations,  organizational  effectiveness,  proiMtion  opportunities,  and 
supervision)  that  measure  the  types  of  organizational  behavior  Palace  Compete 
is  proposed  to  influence  and  added  10  questions  specific  to  the  Palace  Compete 
concept.  Thus,  a  standardized  Air  Force  instrument  was  created  which,  when 
used  at  each  test  base,  will  generate  Air  Force  as  well  as  individual  base 
data.  When  the  test  period  expires  in  2  years,  the  survey  will  be 
readaini stored  with  required  posttest  modifications  to  tn*  questions. 

Similarly,  the  Personnel  Survey  Branch  has  recently  ussd  the  sane  method 
to  develop  an  instrument  to  measu’^  orgjmizational  aspects  relating  to  Total 
Quality  Management  (T(^).  The  factors  used  are  comaunicstion,  confidence  in 
aanag^nt,  contribution/participation,  group  cohesion/woricar  relations, 
organizational  effectiveness,  and  supervision.  This  survey  contains  43  items 
and  also  allows  the  user  to  add  up  to  10  additional  items.  The  instrument  is 
available  to  any  unit  that  wants  to  survey  its  personnel  in  conjunction  with 
ii^leaenting  a  TQK  program.  It  has  been  tailored  to  address  only  TQM- type 
factors,  thereby  saving  unit  personnel  much  time  and  effort  in  building  a 
survey  from  scratch.  Moreover,  it  is  based  on  a  previously  validated 
instrument  and  provides  standardized  results  while  still  giving  the  unii 
flexibility  to  asic  questions. 

The  OCS  has  proven  to  be  an  outstanding  management  tool  because  it  is 
adaptable  to  any  organizational  level  and  provides  a  valid  picture  of  the 
organizational  climate.  Its  best  selling  ^ints  are  that  it  provides  direct 
feedback  to  the  c<NMander  at  any  time,  it  is  solely  the  coomander's  decision 
on  the  use  of  the  inforaation,  and  it  can  be  customized  for  special  uses. 

Users  of  the  instrument  enthusiastically  say  the  XS  is  clearly  a  worthwhile 
and  useful  survey  tool  in  assessing  organizational  health.  For  further 
information  about  the  XS,  contact  HQ  AFMPC/DPMYOS,  Randolph  AFB,  Texas, 

78150. 


References 

Silva,  W.  T.,  Hamilton,  C.,  &  Germadnik,  G.  (1978).  Organizational  climate 
survey  user*s  guide.  Unpublished  manuscript,  Air  Force  Military  Personnel 
Center,  Personnel  Survey  Branch,  Randolph  Air  Force  Base,  Texas. 


A  Proposed  Scientific  Approach  to  Building 

Trust  in  Our  Air  Force  Leadership 

Russell  N.  Cassel,  Colonel,  A.F.  Retired 
CASSEL  PSYCH  CENTER 
Heart  Disease  Risk  Factor  Clinic, 

1362  Santa  Cruz  Court, 

Chula  Vista,  California  92010 


Abstract 

The  purpose  of  study  is  to  provide  a  scientific 
approach  to  the  development  of  trust  among  Air  Force 
leaders.  The  critical  incident  technique  is  suggested 
for  obtaining  objective  empirical  data  pertinent  to  the 
building  of  trust  among  Air  Force  leaders,  and  the 
further  use  of  Q-raethodology  to  determine  the  degree 
of  importance  of  data  gathered.  The  data  is  proposed 
for  use  in  training  Air  Force  personnel  at  varying 
levels  of  organization,  and  assessing  the  degree  of 
knowledge  possessed  in  relation  to  building  of  trust 
by  Air  Force  personnel . 


Excellence  in  Air  Force  leadership  must  be  grounded  in  the 
effective  building  of  trust  in  relation  to  both  followers  and 
superiors.  It  is  not  something  that  will  occur  by  chance,  and 
must  be  pursued  with  the  same  scientific  rigor  that  is  being  used 
in  the  development  of  our  arsenal  of  weapons.  It  is,  of  course, 
presumed  that  no  such  valid  and  empirically  derived  knowledge 
presently  exists,  and  that  such  a  knowledge  base  is  of  first 
order  of  importance  to  the  building  of  trust.  The  present  propos¬ 
al  involves  a  four  stage  process  (Stephenson,  1953;  and  Cassel, 
1973): 

STAGE  I  —  the  use  of  critical  incident  technique  to  ascer¬ 
tain  the  precise  dynamics  involved  in  building  of  trust  at  the 
various  command  levels, 

STAGE  II  --  the  use  of  Q-methodology  to  determine  the  rela¬ 
tive  importance  of  those  dynamics,  and  to  forge  an  assessment 
instrument  to  evaluate  pertinent  knowledge  of  leaders, 

STAGE  III  —  the  development  and  use  of  training  manuals 
fcictoirs  tzo  ^^vslopin^nt  of  trusli  Sijr'S  clcirly 

described,  and  then  made  part  of  Air  Force  training  programs,  and 
STAGE  IV  —  the  use  of  Q-methodology  to  assess  degree  to 
which  Air  Force  personnel  possess  the  knowledge  relative  to  valid 
building  of  trust. 


Critical  Incident  Technique 


The  ''critical  Incident  Technique"  somewhat  revised  is  sug¬ 
gested  for  the  periodic  investigation  of  the  structure  of  trust 
in  relation  to  the  various  levels  of  Air  Force  organizations 
([Cassel  1955,  and  1958).  It  is  not  something  that  can  be  guessed 
about;  nor  found  within  the  pages  of  the  Holy  Bible,  or  some 
other  mighty  treatise,  regardless  of  the  level  and  power  status 
of  the  writers  or  authors.  By  use  of  this  technique  criteria  in 
terms  of  human  behavior  that  is  directly  related  to  the  building 
of  trust  may  be  effectively  identified,  and  carefully  described. 

History  of  Critical  Incident  Technique 

It  has  a  long  history  that  may  be  traced  to  the  work  of  Sir 
Francis  Galton,  almost  a  century  ago.  More  recently  it  was  the 
outgrowth  of  studies  in  the  Aviation  Psychology  Program  of  the 
United  States  Army  Air  Forces  of  World  War  II  (Flanagan,  1954). 
One  of  the  first  studies  carried  out  was  the  analysis  of  the 
specific  reasons  for  failure  in  learning  to  fly  that  were  report¬ 
ed  for  1,000  pilot  candidates  eliminated  from  flight  training 
schools  in  the  summer  and  early  fall  of  1941.  A  second  study, 
which  emphasized  the  importance  of  factual  reports  on  performance 
made  by  competent  observers  carried  out  in  the  winter  of  1943-44 
in  the  8th,  9th,  12th,  and  15th  Air  Forces.  It  was  concerned  with 
the  reasons  for  failure  of  bombing  missions.  Then  in  the  s'ommer 
of  1944  a  series  of  studies  was  planned  on  the  problem  of  combat 
leadership  in  the  United  States  Army  Air  Forces,  and  which,  to  be 
sure,  involved  the  element  of  "building  trust". 

A  Leadership  Q-Sort  Test  developed  by  the  author  is  based  on 
3,667  critical  characteristics  provided  by  400  United  States  Air 
Force  Pre-flight  Cadets  by  Lt.  Joseph  H.  Hastings  for  a  master's 
degree  at  Our  Lady  of  the  Lake  College,  San  .Antonio,  Texas  in 
1957  (Cassel,  1958).  These  characteristics  are  intimately  related 
to  the  concept  of  “building  trust",  and  were  distributed  in  the 
following  six  clusters  in  order  of  importance  as  follows: 

1.  Personal  Integrity. 

2.  Consideration  for  Others. 

3-  Personal  Adjustment  and  Mental  Health. 

4.  Job  Qualifications  and  Technical  Knowledge. 

5.  Decision  Making  Skills. 

6.  Communication  Skills. 

7.  Positive  Attitude. 

Ascertaining  Nature  of  Trust  Building 

A  series  of  studies  is  proposed  that  parallels  the  present 
Air  Force  education  and  training  programs  at  the  various  levels 
of  leadership  involvement.  An  important  part  of  the  education  and 
training  process  would  be  the  gathering  of  critical  incidents 
related  to  “building  trust"  by  Air  Force  leaders  at  the  Non-Com 
School,  Squadron  Officers  Course,  and  the  Air  War  College. 
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‘mis  is  proposed  as  an  extemporaneous  exercise,  as  opposed 
to  a  “take-home"  paper  assignment,  and  which  xvould  entail  no  less 
than  a  two  hour  session.  The  session  would  be  further  broken  down 
into  three  separate  sections,  with  tiunes  allotted  as  follows: 

1.  One  hour  for  gathering  of  positive  critical  incidents, 

2.  Forty-five  minutes  for  negative  critical  incidents,  and 

3.  Fifteen  minutes  for  the  depicting  desirable  qualities. 

Positive  Critical  Incidents 

This  would  be  broken  down  into  two  equally  spaced  or  timed 
sections  for  considerations  as  follows: 

First,  “Think  of  the  most  voutstanding  Air  Force  leader  at 
the  Squadron  Level  (as  one  example,  for  Squadron  Officer's 
Course)  you  have  known  in  terms  of  "building  trust".  Do  net 
mention  his/her  name,  but  carefully  list  the  specific  behavior 
exiiibited  by  that  outstanding  officer  that  caused  you  to  think  it 
involved  "building  trust".  Specifically,  what  did  he/she  do  that 
caused  you  to  rate  him/her  as  being  so  outstanding  in  building 
trust.  Take  your  time  and  list  the  specific  behavior  or  incidents 
of  behavior  one  after  another.  Do  not  be  concerned  about  relating 
the  behavior  being  listed  to  the  building  of  trust.  Simply  list 
the  behavior  that  caused  you  to  feel  the  person  was  outstanding 
in  building  trust. 

Second  {after  maybe  30  minutes),  now  we  must  continue  with 
the  second  part  of  this  session.  Please  stop  where  you  are  and 
begin  with  this  section.  Now  think  of  a  time  when  a  squadron 
officer  (for  that  particular  level  of  investigation)  has  done 
something  you  felt  should  be  encouraged  because  it  seemed  to  be 
in  your  opinion  involved  in  building  trust  for  Air  Force  leader¬ 
ship.  Please  list  these  incidents  of  behavior  one  after  another, 
and  without  concern  to  relating  the  behavior  specifically  to  the 
building  of  trust.  Try  to  be  specific  in  describing  the  behavior. 

Negative  Critical  Incidents 

After  maybe  a  10  minute  break,  announce  that  we  are  now 
ready  to  consider  negative  critical  incidents  related  to  the 
building  of  trust.  We  will  spend  approximately  45  minutes  on  this 
session . 

First,  think  of  the  most  outstanding  incident  of  a  squadron 
officer  that  in  your  opinion  represented  a  failure  to  build 
trust.  Do  not  mention  his/her  name,  but  list  the  specific  inci¬ 
dents  of  behavior  that  caused  you  to  feel  that  this  officer  was 
such  a  failure.  Do  not  try  to  build  a  connection  between  the 
behavior  and  the  building  of  trust. 

Second  (after  maybe  20  minutes),  now  we  have  arrived  at  the 
second  portion  of  this  study.  This  time,  think  of  a  time  when  a 
squadron  officer  did  something  thut  you  thought  was  not  up  to  par 
for  the  building  of  trust.  List  the  specific  behavior  as  you 
observed  it.  Do  not  try  to  build  a  link  to  tne  building  of  trust. 
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Qualities  Related  to  Building  of  Trust 

Finally,  we  have  arrived  at  the  last  portion  of  this  study, 
and  which  will  entail  no  more  than  15  minutes  of  time.  Here  you 
are  to  list  the  qualities  you  believed  are  best  possessed  by  a 
squadron  officer  for  the  building  of  trust.  List  the  qualities 
one  after  another.  This  will  conclude  the  exercise  for  today,  but 
you  may  remain  as  long  as  you  like  to  complete  the  assignment. 

Cluster  Analysis  of  Critical  Incidents 

First  and  foremost  it  is  necessary  that  all  critical  inci¬ 
dents  of  behavior  be  translated  into  positive  incidents.  For  all 
incidents  that,  are  stated  negatively,  they  must  be  changed  or 
converted  into  positive  ones.  Here  emphasis  is  placed  on  the 
building  of  trust,  not  on  a  failure  to  build  trust.  Hov/ever,  it 
i.j  essential  that  one  learn  from  failures;  so  we  have  identified 
the  negative  factors  involved,  and  have  converted  them  to  posi¬ 
tive  forces  for  training  purposes.  After  the  translation  into 
positive  incidents  is  completed,  we  are  ready  for  the  cluster 
analysis . 

Cluster  Analysis 

Here  the  incidents  are  arranged  in  related  groupings,  and  a 
count  of  frequency  of  occurrence  of  the  incidents  is  made  to 
determine  the  prevalence  of  the  incident  among  the  observers.  The 
number  of  clusters  must  be  reduced  to  6;  so  items  must  be  sorted 
in  terms  of  that  level  of  generality.  A  functional  assessment 
instrument  should  include  no  more  than  what  would  require  an  hour 
or  class  period  of  time  for  administering.  This  probably  means 
6U  items,  and  to  include  representative  sampling  for  each  of  the 
6  areas  of  cluster  formations  into  which  the  behavior  descrip¬ 
tions  were  assigned  (Cattell,  1957;  and  Wittenbcrn,  1961). 

Using  Q-Methodology 

Now  we  have  a  list  of  60  items  of  behavior  that  carefully 
selected  persons  have  identified  as  being  critical  to  the  de¬ 
veloping  of  trust  in  their  opinions.  They  are  distributed  equally 
among  the  six  clusters  {part  scores  on  test). 

Standardizing  the  Clusters 

Here  the  same  population  that  contributed  the  incidents  are 
asked  to  rank  the  incidents  now  translated  into  positive  forces 
on  an  11  point  scale,  and  v/ith  numbers  as  indicated; 

11  and  i  --  one  item  each, 

10  and  2  --  three  items  each, 

>  cliiu  ^  ^ 

8  and  4  --  seven  items  each, 

7  and  5  --  nine  item.s  each,  and 
6  --  ten  items. 
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Interpreting  Q-Sort  Test  on  Building  Trust 

First,  it  is  suggested  that  the  typical  Q-Sort  Score  be  used 
to  determine  agreement  between  test  results  for  a  particular 
individual  and  the  norm  group  of  carefully  selected  successful 
officers  who  have  taken  the  test.  Since  thcj  score  involved  is  a 
Pearson  r  (correlation)  it  represents  degree  of  agreeitent,  and 
which  ranges  from  full  agreement  of  1.00,  through  0.00  where 
there  is  little  or  no  agreement,  to  -1.00  where  there  is  an 
opposition  to  agreement. 

Second,  in  order  to  depict  degree  to  which  the  individual 
displays  strengths  and  weaknesses  in  relation  to  the  part  scores, 
the  test  results  may  be  scored  by  use  of  R-methodology ,  and  a 
profile  may  be  made  comparing  the  individual 's  scores  with  the 
Mean  for  the  norm  group  (this  for  part  scores  only) 

Manual  of  Principles  for  Building  Trust 

From  this  data  comes  a  manual  that  serves  as  a  supplement  to 
leadership  development  education  and  training  program.  In  the 
manual  the  basic  principles  deemed  as  excellence  for  building 
trust  are  enumerated  and  described  in  detail  (Cassel  and  Heich- 
berger,  1975), 
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Abstract 

The  purpose  of  this  paper  is  to  evaluate  the  usefulness  of 
the  Occupational  Stress  Inventory  in  assessing  the  impact  of  a 
c^onically  stressful  job,  Basic  Military  Training,  on  the  in- 
dividual  training  instructor. 

To  wist  effectively  use  available  personnel,  the  United  States  Air 
Force  (USAF)  strives  to  accurately  assess  an  individual's  perceptions 
SAd  reactions  to  the  stress  of  difficult  and/or  high  risk  jobs.  Within 
the  civilian  world,  aevecal  instruaenta  are  uaed  for  high  risk  jobs. 

Fopular  teats  include  the  19iPl  or  MMEI**!  for  psthologlcal  indicators, 

tha  CPI  for  general  personality  predispositions,  and  Job  specific  behavioral 

•inulsti(»is  such  as  ln~basket  exercises. 

Regardless  of  initial  screening,  some  jobs  are  inportsnt  and  stressful 
enough  to  oerit  regular  on-^the^job  evaluations  of  an  individual's  ongoing 
stress  ixulicstora.  Within  the  USAF,  air  crews  and  training  instructors 
are  exanplsa  of  those  who  receive  such  regular  evaluations.  Measures 
of  ott-'tkMr'jfob  stress  such  as  the  MMPI  and  various  stress  checklists  need 
to  be  validated  ageiost  the  specific  mllltacy  population  being  studied 
as  one  cannot  autosetically  asauae  generalization  from  a  heterogenous 
normative  sample  to  a  pre-selected  sai^le  of  professionals. 

This  study  looks  at  one  Instrument,  the  Occupational  Streas  Inventory 
(OSI)  (Oalpmr,  &  Spokane,  1987),  to  see  how  effective  it  is  at  measuring 
on-the-job  stress  In  a  military  setting.  The  OSI  was  developed  as  an 
integrated  method  of  measuring  occupational  stress,  strain  and  coping 
resources.  Occupational  stress  is  measured  hj  a  set  of  six  scales  called 
the  Occupational  Rolea  Questionnaire  (ORQ).  ORQ  scales  ate  Role  Overload 
(RO),  Role  Insufficiency  (RI),  Role  Ambiguity  (RA),  Role  Soundary  (RB), 
Responsibility  (R),  and  Physical  Environment  (PE).  The  Personal  Strain 
Questionnaire  (PSQ)  measures  psychological  strain  and  Is  comprised  of 
four  scales:  Vocational  Strain  (VS),  Psychological  Strain  (PSY),  Interpersonal 
Strain  (IS),  and  Physical  Strain  (PHS).  Coping  resourcsa  are  assessed 
by  the  four  scales  that  make  up  the  Personal  Resources  Questionnaire  (PRQ). 

The  PRQ  scales  are:  Eecceation  (RE),  Self-care  (SC),  Social  Support  (SS) 
and  Batlonal/Cognitlve  Coping  (RC). 


The  authors  express  their  appreciation  - o  Too  Svannou  for  his  help 
in  statistical  analysis.  The  ideas  presented  in  this  paper  do  not  necessarily 
reflect  the  official  policy  of  Vilford  Hall  or  the  Department  of  Defense. 


■  y  is  biased  oa  a  sodaX  posad  hy  Osipow  a&d  Spokane  (1983)  in 

;>d}i^  strain,  and  coping  are  related  and  Interact. 

Ibis  aeOdel. postulates  that  vhen  perceived  occupational  stressors  are  equal 
for  t^o  pieople,  differences  in  coping  resources  serve  to  isoderate  the 
'Ceaultlng  strain,  thus  high  stress  alone  does  not  necessarily  predict 
a;^aia  and  strain  varies  as  s  function  of  coping  resources.  While  this 
9»del  has  not  been  tested  thoroughly,  prelininary  data  shows  that  correlations 
between  stress  snd  strain  are  slightly  but  significantly  positive  and 
correlstloas  between  strain  and  coping  tend  to  be  negative  (Osipow,  & 

Spokane,  1983). 

Ifore  rec^t  research  using  the  OSI  found  a  trend  toward  lower  vocational 
psychological,  physical  and  interpersonal  strain  and  higher  recreational, 
self-care  and  rational  cognitive  coping  resources  with  Increasing  age 
(Osipow,  Doty,  &  Spokane,  1985).  To  date  studies  have  found  no  main  effect 
for  sex  (Forney,  1982;  Osipow,  Doty,  &  Spokane,  1985). 

Questions  addressed  in  this  paper  Include:  The  adequacy  of  current 
noms  to  adequately  repreaoit  high  risk/high  stress  sanples  such  as  s 
aonple  of  Basic  Military  Training  Instructors;  the  relationships  between 
age,  IQ  and  gender  to  test  scores;  and,  a  cooper Ison  of  scores  of  TIs 
recoaacnded  for  mental  health  follow-up  to  scores  of  TIs  not  recommended 
for  follow-up. 


Method 


Subjects 


Subjects  were  115  TIs  (90  male,  25  female)  ranging  in  age  from  24 
to  50  years  old  (mean  age  »  31)  with  an  average  IQ  scoire  of  114  and  an 
average  of  11  years  In  service*  Seventy- three  percent  of  the  subjects 
were  married,  12  percent  single  and  17  percent  srparated  or  divorced. 

A  group  of  eight  TIs,  recommended  for  mental  health  follow-up,  were  evaluated 
separately  (7  male,  1  fesiale). 

Instcunentation  aad  Procedure 

Archival  data  from  subjects  most  recent  OSI,  MMPI  and  Shipley  were 
used.  The  Shipley  was  used  to  develop  VAIS  equivalent  IQ  scores.  The 
Physical  Environment  Scale  of  the  OSI  was  not  given  to  subjects  because 
of  earlier  information  that  showed  all  TI's  were  bomogeneoua  in  this  scale. 
Data  was  collated  on  all  TIs  during  required  annual  mental  health  evaluations 
between  March  and  September  1989.  The  doctoral  level  credentlaled  mental 
health  service  providers  doing  the  evaluations  did  not  know  that  the  data 
would  be  analysed  based  upon  recommended  disposition.  Eesults  were  analysed 
using  one  sample  T-tests  and  regression  analysis. 

Eesults 


Male  Technical  Inerructaru  ctspurlcu  olgniflccntly  less  stress  srd 
strain  and  significantly  higher  coping  scores  (p<.05)  than  the  normative 
sample.  For  males,  the  means  of  only  one  scale  of  the  occupational  stress 
measures,  RI,  and  one  coping  scale,  SC,  were  not  significantly  different 
thsji  the  established  norms.  Table  1  shows  the  means  and  standard  deviations 


Scores  as  well  as  contrasting  these  aeans  to  the  nocaative 
acores  equivalent  to  a  X  score  of  50. 


:  Xechnlcal  Instructors  showed  the  same  trend  as  the  males, 

stress  scores  and  two  coping  scales  being  significantly  different 
^<^iii^ed  to  the  ctvillsu.  female  norms.  Table  1  shows  the  female  military 
scores  wd  contrasts  them  to  the  nocaative  group. 


K  correlation  between  the  sample's  F-K  scores  from  their  MMPI's  to 
their  ael^  perceptions  of  stress  was  calculated.  For  every  scale,  there 
was  a  eignificant  correlations  (p<.05),  with  increasingly  negative 
scores  correlatlns  with  lowered  perceptions  of  stress  and  strain,  end 
higher  perceptions  ox  coping  resources. 


Analysis  of  the  relationship  of  age,  sex,  and  IQ  to  OSI  scores  showed 
no  significant  aex  or  IQ  differences  on  any  of  the  subscales.  Significant 
l>ut  modest  correlaticns  %iece  found  between  increasing  age  and  redoced 
Btreas  aa  measured  by  scores  on  VS  (r».202;  p<.05)  and  IS  (r«.192;  pc 
.05} ,  as  well  as  increased  coping  resources  as  measured  by  SC  (r*.260; 
p  <.05). 

Althott^  there  were  (xily  eight  TI's  recommended  for  mental  health 
foUowr-'op  treatment,  their  scores  were  strikingly  different  than  those 
not  recommended  for  mental  health  follow**up,  as  can  be  seen  in  Table  1. 

Table  1 

Means,  Standard  Deviations  for 
Xechnlcal  Instructors  and  the  Normative  Sample 

KEANS  STANDARD  DEVriAXlONS 


Scales 

N 

O&Q: 

mi 

90 

m 

FTl 

25 

FN 

MBFO 

8 

mi 

MN* 

FTI 

FH* 

HHPU 

RO 

20* 

2S 

20* 

26 

23 

5 

7 

7 

8 

7 

El 

22 

23 

22* 

26 

26 

8 

7 

9 

10 

8 

RA 

16* 

21 

16* 

20 

20 

5 

6 

6 

6 

8 

RB 

17* 

20 

19 

22 

22 

6 

6 

7 

3 

9 

E 

PSQ; 

25* 

27 

25 

24 

26 

6 

7 

7 

7 

5 

VS 

14* 

18 

14* 

19 

18 

5 

5 

5 

5 

9 

PSX 

15* 

20 

16* 

21 

20 

6 

7 

8 

8 

9 

IS 

16* 

21 

18* 

27. 

18 

5 

6 

7 

6 

d 

PBS 

PRQ; 

13’^ 

17 

14* 

21 

16 

4 

6 

S 

7 

5 

E£ 

33* 

28 

33* 

28 

27 

8 

6 

7 

7 

8 

SC 

29* 

27 

30 

28 

24 

7 

6 

-f 

< 

7 

9 

SS 

43* 

41 

42 

41 

37 

6 

7 

1 

B 

iO 

EC 

41* 

37 

40* 

37 

34 

6 

6 

6 

6 

8 

mi  •  nsie  trsining  Instructor;  MN  »  male  normative  sample; 
l'‘il  »  female  training  instructor;  FM  ••  female  nonaatlve  sample; 

Khl'J  training  instructore  recoimtended  for  mental  health  £ollow'-up. 

*■  Btat^dard  deviation  for  the  normative  group  were  computed  from  Osipov's 
T  scale  profiles.  *  ••  p<.05 
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HRaai  0}i»  Cvopates  the  eight  Tl's  ecoree  to  the  T  scores  of  the  civilian 
noxahr  the  tl'a  scoces  ace  belou  oc  equal  to  a  T  score  of  50  on  six  of 
the  ttlna  stress  scales  Beasured.  Only  in  this  group  of  eight  did  we  find 
avacage  coping  scores  below  the  T  score  of  50.  Table  1  gives  a  visual 
picture  of  these  resulta. 

Discussion 

Baaed  on  the  current  study,  It  is  concluded  that  current  available 
nozaa  do  not  adequately  represent  the  typical  profile  oc  cange  of  scoces 
found  in  the  allltacy  saiaple.  To  appeopr lately  use  such  oeasuces  as  the 
OSI  iu  the  ttUitacy,  norns  from  the  specific  sample  need  to  be  developed. 
Otheewiae,  ccApaclaon  of  an  individual's  profile  to  existing  norms  could 
easily  produce  an  unrealistic  picture  of  how  well  the  person  is  doing 
with  occupations!  stress,  personsl  strain  and  adequate  pecsooal  resources. 

The  affects  of  social  daairahllity  also  need  to  be  studied  and  controlled. 
In  the  case  of  basic  milltacy  training  instructors,  their  highly  nagatlva 
FHC  acorea  Indicate  a  wall'^af ended  group  who  stiniaize  problems.  The 
significant  corcalations  of  their  scores  to  thalc  low  OSI  stress  snd 
high  coping  scores  see  intarpeetad  as  an  Indication  that  they  minimized 
strain  and  maximized  coping  in  responding  to  the  questionnaire.  'Riese 
tandenclas  to  mlnimisa  strain  and  maximize  coping  may  be  adaptive  in  that 
tba  TIs  perhaps  parcel va  stress  and  strain  as  manageable  challangea. 
Honethalass,  these  types  of  perceptual  predispositions  need  to  be  taken 
Into  account  for  accurate  assessment  to  occur. 

Osipov  postulates  dlffacancas  in  Individual  coping  resources  will 
moderate  differences  in  perceived  strain.  The  data  in  Table  1  indicates 
fhat  TIs  eacomauaded  fer  mental  healdi  follow  up  (MHFU)  perceive  themselves 
to  have  many  fewer  personal  rasourcaa.  The  HUFO  groups,  although  not 
scoring  above  the  normative  semple's  I  score  of  50  on  six  of  the  nine 
ne^^ursd  stress/strsin  scsle,  do  fell  below  the  T  score  of  50  on  all 
resources.  Compared  to  the  means  of  other  TIs,  the  differences 
between  IffiiFO  TIs  and  other  TIs  are  even  more  drsmatic.  In  this  aspect, 

Osipov's  general  aodel  is  supported  althou^^  serious  questions  about  the 
genaralizabillty  and  applicability  of  bis  normative  group  remain. 
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Cohesion  and  unit  Bcraio  iisve  been  investigated  in  Army 
cottbat  units  for  «any  years.  Relatively  little  work  has 
focused  on  Arvy  Reserve  units.  A  Measure  of  cohesion  developed 
by  Slebold  and  Kelly  (1988)  was  srjdified  for  Ar^y  Reserve  units. 
P^choaetric  properties  of  the  Reserve  cohesion  instrinaent 
are  presented. 


An^  Research  Br^h  studies  ot  unit  norale  during  the  1940s 
(Stouffer  et  at,  1949}  were  part  of  an  extensive  exasination  of  the 
attitudes  cf  Acsrican  soldiers  during  World  War  11.  Measures  of  group 
c^^esiveness  in  coabat  units  before  the  NorBandy  invasion  as  well  as 
Measures  of  coobat  effectiveness  of  the  units  during  and  after  the 
invasion  were  exaitined;  units  with  higher  cohesiveness  ^rfomed 
better.  Shi Is  and  Janowitx  (1948)  docuaented  the  cohesiveness  in  the 
Geraan  Uehnaacht  in  World  War  II.  The  aore  cohesive  the  unit,  the 
better  the  unit  was  able  to  perfora  its  coabat  Mission.  Gal  (1984, 
1988a,  1988b)  has  exaained  unit  Morale  in  Israeli  coabat  troops. 
Ingrabaa  and  Hanning  (1981)  have  exaained  the  iaportance  of  cohesion 
in  the  survival  of  Military  units  in  coabat.  Gal  and  Manning  (1985) 
conducted  cross  cultural  coaparisons  of  aorale  in  Israeli  and  in 
United  States  Aray  forces.  Mangel sdorff  and  King  (1985)  exaained 
aultinati(»tal  efforts  at  Measuring  cohesion  and  Motivation  in  the 
araed  forces.  The  interrelationships  between  aorale,  coabat 
readiness,  Motivation,  perforaance  of  ailitary  Missions,  and  cohesion 
suggest  the  need  for  further  exaaination  of  the  variables  pertaining 
to  a  unit's  effectiveness. 

Scientists  froa  the  Walter  Reed  Aray  Institute  of  Research 
(WRAIR)  have  been  Involved  In  the  Headquarters,  Oepartaent  of  the  Army 
field  evaluation  of  the  Unit  Manning  Systea  since  1381.  The  New 
Manning  Systea  (now  the  Unit  Manning  Systea)  was  developed  in  1981 
along  guidelines  derived  froa  the  1979  H()DA  ODCSPER>sponsored  Aray 
Cohesion  and  Stability  Task  Force.  The  developaent  of  the  Unit 
Mannii^  Systea  and  its  COHORT  (Cohesion,  Operational  Readiness,  and 
Training)  unit  aov»ent  systea  was  undertaken  to  create  ailitary  units 
possessing  unit  cohesion  that  would  resist  psychological  breakdown  due 
to  coabat  stress.  The  evaluations  conducted  by  WRAIR,  using  survey 
and  interview  data  at  different  points  in  tiae*  confiraed  that  COHORT 
units  resulted  in  iiuroved  unit  aorale  and  enhanced  perfomance 
(Marlowe,  1985,  1986).  The  WRAIR  research  activities  involved 


£Lr^£>‘£  cf  “2!i3d1fir  j-illV  (hia^^dlfenslpns  thQiiQht  to  be  associated 
with  iftdi vidua!  coeiuit  readiness  and  psychologica!  sustainablTity  in 
cpobat),  spouse  surveys,  a  battalion-rotation  family-unit-coaBiunity 
study,  unit  intervievt^,  and  unit  aorale  and  cohesion  surveys  (Marlowe, 
1935).  Griffith  (1988)  described  the  unit  cohesion  and  morale 
oeasures  in  the  Unit  Replacement  study  conducted  by  HRAIR. 

At  the  U.S.  Ara^  Research  Institute,  measures  of  cohesion  were 
developed  for  knt^  combat  units.  A  lon^  questionnaire  on  cohesion 
(the  Coohat  Rlatoon  Cc^eslon  Questionnaire)  was  developed,  then  later 
revis^  to  a  short  version  which  became  the  Platoon  Cohesion  Index 
(Siebcld  and  Kelly,  1988).  The  Platoon  Cohesion  Index  (PCI)  is  a 
relatively  short  (20  questions),  focused  measure  of  platoon  cohesion 
which  has  been  used  with  active  duty  Am^  platoons.  The 
questionnaires  were  administered  to  44  Army  platoons  (752  soldier^}. 

An  individual  respondent  level  factor  analysis  of  the  20  items 
produced  three  factors  vdiich  accounted  for  60.1  percent  of  the  coonon 
variance.  The  three  factors  dealt  with  three  types  of  bonding: 
horizontal  (relations  among  peers),  vertical  (relations  between 
leaders  and  subordinates),  and  organizational  (relations  between  unit 
westtrs  and  the  unit  as  a  whole).  Each  type  of  relationship  has  two 
aspects:  an  affective  (feeling,  emotional,  reactive)  one  and  an 
instrumental  (action,  task,  proactive)  one.  The  PCI  was  developed  as  a 
pilot  instnoaent  for  use  in  a  unit  self  assessment  program  to  build 
and  maintain  cohesion.  The  PCI  is  also  capable  of  being  incorporated 
into  larger  surveys  to  measure  unit  climate  or  other  unit  conditions. 

The  purposes  of  the  present  research  were  to  develop  a  survey 
instrument  which  would  assess  cohesion  in  Army  reserve  units,  to 
assess  the  psychometric  properties  of  the  instri»ent,  and  to  examine 
its  uses  with  reserve  units. 


Method 


SubJgGtS 

Soldiers  from  eight  Army  reserve  units  were  tested  during  field 
training  exercises  conducted  during  the  summer  of  1989.  A  total  of 
481  soldiers  participated. 

Pcacedure 

As  part  of  the  field  training  exercises  conducted  during  the 
summer  of  1939,  several  reserve  OM  (psychiatric  detachment)  teams 
acbninistered  the  Unit  Cohesion  Index  to  selected  reserve  units.  The 
Unit  Cohesion  Index  was  administered  and  collected  by  the  OM  teams. 
Selected  units  were  assessed  before  and  after  completion  of  their 
training. 

The  Unit  Cohesion  Index  consists  of  20  items  using  5-point  LiJcert 
scales  vdiich  were  modified  from  the  Platoon  Cohesion  Index  (Siebold 
end  Kelly,  1988).  For  17  of  the  items,  a  5-point  Likert  format  was 
employed;  “Strongly  Agree*  (1)  to  "Strongly  Disagree"  (5). 


Aaal^S(Ss  of  the  Unit  Cohesion  Index  results  Included  factor 
analysis  of  the  20  itCBS.  reliability  deterwinations  of  the  subscales, 
and  analysis  of  variance  co^>arisons  for  units  which  were  adainistered 
the  Unit  Cohesion  Index  on  sore  than  one  occasion.  Evaluations  of 
units  by  expert  observers  were  coopared  with  the  Unit  Cohesion  Index 
Measures. 


Results 

Eaclipr  analysis 

Responses  froa  the  481  soldiers  were  submitted  to  a  principal 
coBponeirts  factor  analysis  of  the  20  items.  Four  factors  with 
eigMvalues  greater  than  1.0  were  obtained,  accounting  for  58.3%  of 
the  ctnculative  variance.  A  Varioax  rotation  with  Kaiser  normal ization 
was  perfomed  on  the  factors.  Items  having  an  item- total  score  of  .40 
and  greater  were  extracted.  Three  item  clusters  with  at  least  five 
iteos  in  each  were  obtained. 

tella&l.llty  IstiMtes 

The  three  item  clusters  were  subjected  to  reliability  estimates 
using  the  Kuder  Richardson  procedure  to  calculate  coefficient  alpha. 
The  coefficient  alphas  for  the  separate  scales  were:  scale  1  (8  it^s) 
was  .891;  scale  2  (7  items)  was  .80S;  and  scale  3  (5  items)  was  .750. 
The  scales  were  labeled  as  follows  -  scale  1  (leaders),  scale  2  (new 
aenbers),  and  scale  3  (unit  cohesion). 

Level  of  Unit  Cohesion 

Scores  for  individual  units  on  the  three  scales  were  evaluated. 
The  mean  scores  for  all  units  indicated  perceived  satisfaction  with 
the  units  and  moderately  high  degrees  of  unit  cohesion.  Table  1 
d^icts  the  findings.  Units  that  had  high  levels  of  unit  cohesion 
were  also  the  units  recognized  by  the  expert  observers  as  performing 
quite  well  during  the  training  exercises. 


Table  1 

Reserve  Unit  Mean  Scores  on  Unit  Cohesion  Index  Scales 

SCfllft.  j^gplent _ Huablir.  of _ Range  of  Unit _ Unit  Mean  Score 

Item _ Mean  Scores  of  All  Units 

1  Leaders  8  11.5  -  22.0  17.0 

2  New  members  7  9.9  -  14.7  13.2 

3  Unit  Cohesion  5  7.3  -  10.7  9.9 

Note:  Low  scores  are  positive:  (1)  “Strongly  Agree*  to  (5)  “Strongly 
Disagree" 
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•yaiysis  .ST  ..Yariancg 

Cooparisorts  were  made  on  the  scales  for  units  which  had  taken  the 
Unit  C(^esion  Index  before  and  after  the  training.  Of  the  four  units 
on  which  coo^nsons  were  oade,  there  were  significant  differences  for 
two  units  on  scale  3  (Unit  Cohesion).  For  one  unit,  there  was  a 
significant  difference  for  scale  1  (Leaders),  with  the  unit  being  more 
dissatisfied  after  the  training  exercises.  This  same  unit  showed  a 
significant  drop  in  scale  3  (Unit  Cohesion)  as  well.  For  the  units 
that  had  laaer  scores  (greater  unit  cohesion)  before  training,  even 
more  unit  cohesion  was  reported  after  the  training  exercises. 


Discussion 

Military  history  has  downstrated  the  ia^ortance  of  small  unit 
cohesion  in  the  ability  of  araies  to  fight  and  win.  Morale  and 
cohesion  surveys  are  routinely  administered  to  determine  if  an  Israeli 
unit  is  deployable.  Coa^arisons  between  the  United  States  and  Israeli 
Defence  Force  units  (Gal  and  Manning,  19fi5)  suggested  that  unit  morale 
aaong  United  States  troops  was  a^re  closely  associated  with  technical 
aspects  of  the  unit  (condition  of  weapons  and  perceived  combat 
readiness),  vdiile  among  the  IDF  units  morale  was  associated  with  more 
human  aspects  (cohesion,  relationships,  and  confidence  in  ctmsmanders) . 

As  the  United  States  Army  involves  its  Reserve  and  National  Guard 
units  more  in  Total  Army  efforts,  it  becomes  important  to  assess  the 
morale  and  cohesion  of  Reserve  and  Guard  units.  Mangelsdorff  (1988) 
has  examined  unit  climate  and  morale  in  some  state  guard  units;  the 
levels  of  morale  were  comparable  to  those  of  active  duty  units. 

In  the  present  study,  a  survey  instrument  which  had  acceptable 
psychometric  properties  was  developed.  The  level  of  cohesion  found 
with  the  Unit  Cohesion  Index  in  the  reserve  units  was  at  least  as  high 
as  that  obtained  in  active  duty  units  using  the  Platoon  Cohesion 
Index.  The  Unit  Cohesion  Index  was  sensitive  to  detecting  high  levels 
of  cohesion  and  positive  unit  attitudes  in  some  of  the  units  ^ich 
performed  well.  Further  testing  of  the  Unit  Cohesion  Index  is  needed 
to  examine  other  applications  for  use  with  reserve  units. 


References 

Gal,  R.  (1984).  Unit  morale:  Some  observations  on  its  Israeli  version.  In 
A.D.  tangelsdorff,  J.M.  King,  &  D.E.  O'Brien  (Eds.),  Proceedings.  Third 
Users'  Workshop  on  Combat  Stress;  Cohesion.  Fort  Sam  Houston,  TX;  Health 
Care  Studies  and  Clinical  Investigation  Activity.  (NTIS:  AD  A149035). 

Gal,  R.  (1986a).  Unit  morale:  From  a  theoretical  puzzle  to  an  empirical 
illustration  -  An  Israeli  exan^le.  Journal  of  Applied  Social  Psychology. 
16,  549-564. 

Gal,  R.  (1986b).  A  portrait  of  the  Israeli  Soldier.  Westport,  CN:  Greenwood 
Press. 


if  f  ^  «V*^|  4  •^i**  ^^4*  f 


A  tfuSs-itatiwal 


of  S^r^lc: 


ass^ssaent:  Israeli  Defence  Forces  and  US  Army.  In  A.D.  Mangelsdorff ,  J.M. 
Kins,  &  D.E.  0‘Brieo  (Eds.)  Proceedings.  Fotirth  Users*  Workshop  on 
Cofflbat  Stress;  Lessons  learned  in  recent  operational  experiences.  Fort 
Sam  Houston,  TX:  Health  Care  Studies  and  Clinical  Investigation 
Activity.  (NTIS:  AD  A160228). 


Griffith,  J.  (1983).  Heasureaent  of  group  cohesion  in  U.S.  Artny  units, 
and  Applied  Social  Psychology.  9.  149-71. 


Bask 


Ingraham,  L.H.,  &  Manning,  F.J.  (1931).  Cohesion:  Who  needs  it,  what  is  it  and 
how  do  we  get  it  to  them?  Military  Review.  61.  2-12. 


Mangelsdorff,  A.D.,  &  King,  J.M.  (li^).  Cohesion  and  motivation: 
Multi-national  efforts  in  the  armed  forces.  (Consultation  Report 
#35-001).  Fort  Sam  Houston,  TX:  Health  Care  Studies  and  Clinical 
Investigation  Activity.  (NTIS:  AD  A1159940). 


Mangelsdorff,  A.D.  Texas  National  Guard:  Unit  Climate  Survey  Pilot 
Project.  (Consultation  Report  #88-004).  Fort  Sam  Houston,  TX: 

Health  Care  Studies  and  Clinical  Investigation  Activity. 

Marlowe,  D.H.  (1985).  New  Manning  System  field  evaluation  (Technical  report 
No.  1).  Washington,  DC:  Walter  Reed  Army  Institute  of  Research. 

Marlowe,  D.H.  (1986).  New  Manning  System  field  evaluation  (Technical  report 
Ho.  4).  Washington,  DC:  Walter  Reed  An^  Institute  of  Research. 

Shils,  E.A.,  &  Janowitz,  M.  (1948).  Cohesion  and  disintegration  in  the 
Wehrmacht  in  World  War  II.  Public  Opinion  Quarterly.  12.  29-42. 

Siebold,  6.L.,  &  Kelly,  O.R.  (1988).  Development  of  the  Platoon  Cohesion  Index 
(PCI).  Alexandria,  VA:  Army  Research  Institute. 

Stouffer,  S.A.,  Lumsdaine,  A. A.,  Lumsdaine,  M.H.,  Williams,  R.M.,  Jr.,  Smith, 
M.B.,  Janis,  I.L.,  Stan.  S.A.,  &  Cottrell,  L.S.  (Eds.).  (1949).  The 

Anffiricafl,.59ld.1er- ■  CoiBbdt..ftDd-Lts .dftfirsath.. _ Stu(iies__in  social  psychology 

(Vol.  2).  Princeton,  NJ;  Princeton  University  Press. 


307 


The  tise  of  Engineering  Psychological  Keasures 
.  In  Hilicary  Equipment  Field  Testing 

George  Anitole  and  Elonald  L.  Johnson 
G.S.  Ara^  Belvolr  Research,  hevelopoect  and  Engineering  Center 
Fort  Belvolr,  Virginia  22060-5606 
Christopher  J.  Keubert 
G.S.  Army  Materiel  Coamand 
Alexandria,  Virginia  22333-0001 

Abstract 

The  addition  of  the  Engineering  Psychologist  to  research  teams  has 
added  new  dimensions  to  tne  evaluation  of  military  equipment  in  field 
testing.  Historically,  measures  such  as  probability  of  detection  and 
range  of  detection  have  been  important  evalxiators  of  equipment.  The 
Engineering  Psychologist  has  added  such  measures  as  visual  cues  and 
false-detection  rates;  the  latter  is  the  sxibject  of  this  report.  This 
paper  explains  the  false-detection  variable,  and  traces  its  use  in  two 
field  tests  at  Fort  Oevens,  MA  using  military  ground  observers. 

Such  standard  test  variables  as  probabill^  of  detection  and  range  of 
detection  have  been  accepted  for  years  by  the  testing  community  as  measures  of 
camouflage  effectiveness.  Engineers  have  \^ed  these  variables  to  develop 
requirement  documents  that  prototype  camouflage  equipment'^  must  meet  before 
becoming  standard,  fielded  equipment.  Vlth  the  advent  of  the  engineering 
psychologist,  now  working  in  tiiese  development  areas,  additional  test  variables 
are  now  cming  into  use.  This  report  will  describe  two  studies  in  which  the 
engineering  psychological  variable,  false-detection  rate,  bas  been  used  to 
complement  the  standard  test  variable,  range  of  detection,  In  the  determination 
of  the  camouflage  effectiveness  of  voodlaxA  camouflage  nets  aiul  camouflage- 
patterned  Five-Soldier  Crew  Tents  by  ground  observers.  The  false-detection  rate 
Is  defined  as  the  nuaiber  of  times  e  target,  other  than  the  test  target,  is 
detected  by  an  observer.  In  these  studies,  such  detections  are  rocks,  trees, 
shadows,  etc.  The  number  of  these  detections  is  a  function  of  how  difficult  it 
la  to  detect  the  test  target.  The  more  difficult  the  detection  task,  the  greater 
the  number  of  false  detections .  The  field  tests  were  conducted  by  the  Belvoir 
EU>&E  Center  at  Fort  Deveos,  Massachusetts,  in  the  summer  of  1987. 

Method 

Icst.,TflW£8; _ ygadlaxid.  .CftBvuflflgg  MctB 

Four  camouflage  nets  were  evaluated.  They  are  described  below: 

U.S.  An^  Standard  Voodland  hexagon  Camouflage  Net- -The  Army  standard  net 
has  116  separate  patches  of  incised  camouflage  cloth  (garnish)  per  hexagon.  The 
garnish  is  attached  to  one  side  of  the  base  net.  The  net  weighs  0.0504  Ib./sq. 
ft.,  or  34  lb.  per  hexagon. 

Test  Net  A,  65 -Piece  Hexagon  Woodland  Net- -This  net  is  similar  to  the 
standard  hexagon  net,  except  that  the  garnish  patches  are  larger  and  number  65 
per  hexagon.  It  weighs  0.0474  Ib/sq.  ft.,  or  32  lb.  per  hexagon. 


Test  Net  B,  Lightweight  Ket--Iliis  net  is  made  out  of  uninciced,  uncoated 
garnish  base  cloth  which  has  been  sprayed  with  a  pigment  coating  to  lightly  fill 
up  the  pores  of  the  material.  This  net  is  rectangular,  and  roughly  39  ft  x  40 
ft.,  giving  it  an  area  of  1560  sq.  ft.  It  weighs  0.0166  Ib./sq.  ft.,  or  26  lb. 
total. 


Test  Net  C,  Lightweight  Net- -This  liet  is  made  of  a  light  knitted  polyester 
material  with  a  standard  camouflage  imif ona  woodland  pattern  of  four  colors . 
This  net  is  rectangular  in  shape,  roughly  25  ft  x  35  ft,  and  has  an  area  of  875 
sq  ft.  It  weighs  0.0183  Ib/sq.  ft.,  or  16  lb.  total. 

Test  Targets:  Five -Soldier  Crev_Xe.nts 

Five,  Five-Soldier  Crew  Tents  were  supplied  by  Natick  ROSlE  Center  for  this 
study  in  the  following  patterns  and  colors : 

Tent  A- 'Standard  size  four-color  uniform  pattern  repeated  every  27.25 

Inches. 

Tent  B-- Forest  Green 

Tent  C- -Expanded  four-color  uniform  pattern  repeated  every  36  inches. 

Tent  D--Expanded  four-color  \iniform  pattern  repeated  every  50  inches. 

Tent  E- -Green  483  (cloth  dye  equivalent  to  paint  color  Green  383  used  on 

military  vehicles) . 

The  studies  were  conducted  at  the  Turner  Drop  Zone,  Ft.  Devens, 
Kassachusetts ,  a  large  cleared  tract  of  land  surrounded  by  a  mixture  of 
coniferous  and  deciduous  forest  resembling  a  central  European  background.  Two 
test  sites  were  selected.  Site  #1  was  located  on  the  western  end  of  the  drop 
zone,  so  that  the  morning  sxm  shone  directly  upon  the  test  targets.  Site  #2  was 
located  on  the  eastern  edge  of  the  drop  zone,  so  that  the  afternoon  sun  shone 
directly  upon  the  test  targets.  An  observation  path,  starting  at  the  opposite 
end  of  the  drop  zone  from  the  test  target  location,  was  laid  out  for  each  site. 
Each  path  followed  zig-zag,  random-length  directions  toward  its  test  site,  and 
afforded  a  continuous  line  of  sight  to  the  test  target  location.  The  paths  were 
surveyed  and  marked  at  approximately  50-meter  intervals  using  random  letter 
markers . 

7?s£.  S\ib.1f£.t;g 

The  test  subjects  were  enlisted  soldiers  from  Ft.  Devens ,  MA.  All  personnel 
had  at  least  20/30  corrected  vision  and  normal  color  vision.  A  total  of  153 
observed  the  Five -Soldier  Crew  Tents,  and  120  observed  the  camouflage  nets.  A 
minimum  of  30  observers  were  used  at  each  site  for  each  test  target  in  order  to 
employ  parametric  statistics  in  analyzing  the  data’^.  Each  observer  was  used 
only  once . 
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Tfest  Procedure 


The  test  procedure  was  to  determine  the  detection  distances  of  the  Five* 
Soldier  Crew  Tents  and  the  camouflage  nets  by  searching  for  them  while  traveling 
along  the  predetermined  measured  paths.  Each  ground  observer  started  at  the 
beginning  of  the  observation  path,  i.e.,  marker  S  for  Site  #1  and  marker  F  for 
Site  >**2.  The  observer  rode  in  the  back  of  an  open  5/4- ton  truck  accompanied  by 
a  data  collector.  The  truck  traveled  dovm  tlie  observation  path  at  a  very  slow 
speed,  about  3-5  i^h.  The  observer  was  instructed  to  look  for  military  targets 
in  all  directions,  except  directly  tc  his  rear.  Uhen  a  possible  target  was 
detected,  the  observer  informed  the  data  collector,  and  pointed  to  the  target. 
The  truck  was  Ismediately  stopped,  and  the  data  collector  sighted  the  apparent 
target.  If  the  sighting  was  correct,  i.e.,  the  Five-Soldier  Crew  Tent  or 
camouflage  net,  the  data  collector  recorded  the  alphabetical  marker  nearest  the 
truck.  If  the  detection  was  not  correct,  the  false  detection  was  recorded,  and 
the  data  collector  informed  the  observer  to  continue  looking.  The  truck  then 
proceeded  down  the  observation  path.  This  search  process  was  repeated  until  the 
correct  test  target  was  located.  The  tent  and  net  tests  were  run  consecutively. 

The  test  targets  were  rotated  individually  between  the  two  test  sites  on  a 
dally  basis,  until  all  had  been  observed  by  at  least  IS  observers  at  each  site. 
Their  orientations  with  respect  to  the  sun  were  kept  constant  at  both  test  sites. 
The  Five-Soldier  Crew  Tents  and  camouflage  nets  were  positioned  so  chat  a  full 
side  was  facing  the  direction  of  observer  approach. 

Results 


_ Woodland  Nets 

Table  1  indicates  which  camouflage  nets  differed  significantly  from  each 
other. 


Table  1.  Duncan's  Multiple -Range  Test- -Range  of  Detection  (Meters) 


Subset  1 

Group  Hear. 


Subset  2 

Group  Kean 


Subset  3 

Group  Mean 


Axnay  Standard  Net  414.41 
Net  A  469.97 


Net  C 

Lightweight  665.99 


Net  B 

Lightweight  886.14 


The  subsets  are  significatit  at  «  -  0.05. 

The  Duncan's  Multiple -Range  Test  separates  a  set  of  significantly  different 
means  into  subsets  of  homogeneous  means  The  ranges  of  detection  were  the 
shortest  for  the  Army  Standard  net  and  Net  A.  These  net  ranges  were 
significantly  (<x  -  C.05)  shorter  chan  the  range  of  detection  for  Nets  B  and  C. 
Net  C  had  a  range  of  detection  significantly  (oc  —  0.05)  shorter  than  Net  B. 

_ Woodland  Nets 


Tabic  2  indicates  which  camouflage  nets  had  significant  rates  of  false 
detections . 


’  2.  Multiple-EAiage  Test--&ate  of  False  Detections 

■  ^  '  SaSjset  1  Subset  2  Subset  3 

^an  Croup  Mean  Croup  Mean 

Met  B  Set  G  Army  Standard  Set  A. 63 

Id^ttfei^t  1.80  Llghcvei^t  3.07  Set  A  5.10 

Set  S,  ll^tweighc  net,  had  a  algnlficently  («  -  O.OS)  lover  rate  of  false 
detections  than  Set  C,  lightweight  net.  Set  C,  lightweight  net,  has  a 
significantly  («  0.05)  lover  rate  of  false  detection  tiian  the  Ansy  Standard 

net  and  Set  A. 

I>g±fectl<a  .Data:  ■■Five-Soldier  Crew  Tents 

Table  3  indicates  which  tents  differed  significantly  from  each  other. 

Table  3.  Duncan's  Multiple -Range  Test-'Range  of  Detection  (Mecers) 


SUBSET  1 

SUBSET  2 

SUBSET  3 

GROUP 

H£AK 

GR£RJP 

MEAN 

GROUP 

MEAN 

A 

327,54 

C 

3S1.17 

E 

674.88 

C 

351.17 

D 

387.12 

D 

387.12 

B 

427.71 

The  harmosvic  nean  grouj*  size  is  30.58.  The  subsets  are  significant  at  «  -  0,05. 

The  Duncan's  Multiple-Range  Test  separates  a  set  of  significantly  different 
neans  into  subsets  of  hoofcogeneous  neans.  One  of  tdte  assuoptlons  is  that  each 
randcaa  eaiople  is  of  equal  size.  Since  this  was  not  true,  the  hamonlc  nean  of 
the  group  was  used  as  tiie  group  size.  As  seen  above,  the  range  of  detection  was 
the  shortest  for  tents  A,  C,  Kid  D,  and  these  tents  do  not  differ  significantly 
froa  each  other  (<x  ••  0.05) .  Teat  E  had  the  longest  nean  range  of  detection,  and 
is  significantly  (oc  0.05)  different  froa  the  other  four  tents  in  this  respect. 

£filsj-Bfl£jec.tipn.P&tai.  Five -Soldier  Crew  Tents 

Table  4  indicates  which  tents  had  significant  rates  of  false  detections. 

Table  4.  Duncan's  Multiple-Range  Test  (Rates  of  False  Detection) 


SUBSET  1 

GROUP 

MEAN 

SUBSET  2 

GROUP 

MEAN 

E 

2.50 

B 

3.53 

C 

3.38 

D 

3.87 

B 

3.53 

A 

4.87 

D 

3.87 

Haraonlc  aean  group  size  is  30.58.  The  rates  of  false  detection  for  tent  groups 
E,  C,  B,  and  D,  and  B,  D,  and  A  were  significantly  different  («  -  0.03). 


Discussion 


As  can  be  seen  from  Tables  1  and  3,  Che  use  of  Che  standard  test  variable, 
range  of  detection,  has  been  very  successful  in  identifying  the  camouflage  nets 
and  Five*Soidier  Crev  Tents  chat  are  most  camouflage-effective,  i.e.  ,  have  the 
shortest  detection  range.  In  this  case,  camouflage  nets  Army  Standard,  and  Net 
A,  and  tents  A,  C,  and  D,  were  Che  most  effective.  Before  looking  at  the  results 
of  the  engineering  psychological  test  variable  for  nets,  false  detections  (Table 
2),  one  oust  remember  that  in  a  perfect  world,  the  nets  and  cents  chat  had  the 
shortest  detection  ranges  would  have  the  greatest  rate  of  false  detections ,  while 
the  test  iteas  with  the  larger  detection  ranges  would  have  the  smaller  rates  of 
false  detections.  A  review  of  the  net  Tables  1  and  2  will  show  a  perfect  match 
with  the  above  expectation.  Both  the  standard  engineering  test  measurement  of 
detection  range,  and  the  engineering  psychological  test  measurement  of  rate  of 
false  detections  have  yielded  very  clear,  clean  data  about  the  camouflage 
effectiveness  of  the  woodland  nets  being  investigated. 

The  data  concerning  tlie  camouflage  effectiveness  of  the  Five -Soldier  Crew 
Tents  (Tables  3  and  4)  are  not  as  clear-cut.  The  range -of -detection  data 
identified  tents  A,  C,  and  D  as  the  most  camouflage- effective ,  while  the  false- 
detection  data  identified  tents  A,  B,  and  D.  Beth  test  measurements  identified 
tent  A  as  the  most  camouflage -effective ,  with  the  largest  rate  of  false 
detections  and  tlie  shortest  detection  range.  Tent  £  was  identified  as  among  the 
least  effective  by  both  test  measurements.  Duncan's  Multiple -Range  Test,  using 
both  te.st  measurements,  has  not  been  able  to  clearly  decide  upon  the  ranking  of 
tents  C  and  B  as  to  camouflage  effectiveness.  They  have  been  placed  in 
overlapping  groups. 

From  the  above  data,  it  has  been  seen  that  the  engineering  psychological 
test  measurements  such  as  rate  of  false  detections  are  of  value  in  the 
determination  of  camouflage  effectiveness.  These  measurements  are  neither 
generally  known,  nor  utilized  by  most  test  engineers.  The  addition  of  the 
engineering  psychologist  to  Che  research  team  has  developed  new  avenues  of 
research,  which  will  ensure  more  accurate  evaluation  of  prototype  equipment. 

Conclusions 

This  paper  discusses  the  role  of  the  Engineering  Psychologist  in  assisting 
engineers  in  the  field  test  of  military  equipment.  In  addition  to  the  standard 
field  test  measurements  of  range  of  detection  and  probability  of  detection,  the 
engineering  psychologist  brings  additional  test  measures,  such  as  rate  of  false 
detections.  A  review  of  two  field  te.sts  conducted  at  Fort  Devens ,  MA,  indicated 
chat  the  psychological  variable  of  false-detection  rate  was  most  advantageous 
in  the  identification  of  the  most  camouflage -effective  woodland  camouflage  nets 
and  camouflage -patterned  Five-Soldier  Crew  Tents. 
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D«nrye  B.  Beringer  and  htotcy  Lov^»e 
New  lexica  State  U^ersity 


Abstract 


A  nimber  of  Invos^g^ofs  have  examined  object  displays  in  formats  IrKlutSng 
tacUuti^es,  triar^les,  am  higher-order  potygrms.  in  a  number  of  cases  triangular 
(ormads  etere  shown  to  be  Irtferior  to  bargmphs  and  other  ^sfdays.  Mhot^h  fftese 
dSfferences  have  been  attributed  to  emergent  features  effects  In  many  ca^Sj  a  more 
stfbjt/a  bias  relating  to  the  “oblique  effect'  (differential  perception  favoring 
horizonb^  and  vertical  lines  as  competed  to  diagcml  Unos)  may  be  present  as  watf. 
A  sbJdy  was  corrducted  to  examine  bias  In  the  corr^iletion  of  partiai  ^tomebic  dgures 
having  xMffermt  wierHatbns  relative  to  an  imptied  Cartesiam  coordinate  grid.  An 
oversdi  bias  was  foutui  to  complete  right  angles  as  squares  without  regard  to  ffteir 
ortentaJtion,  A  replication  produced  differential  bias  according  to  orlerdation  with 
hmzoiJt^  arid  vetUcsi  lines  being  used  to  comply  figures.  These  preiefenoes  for 
horizontal  and  vertical  lines  in  comblnatkm  with  “obiiqua  effect  data  rebiforoe  tite 
notion  titat  rectUinear  forms  of  display  are  urtique  in  the  ease  and  rapidity  wltii 
whldt  they  tat^  be  irtierpreted.  These  quMies  have  implications  lor  the  design  and 
use  of  both  kiteffbted  and  d^ect  disfdays. 


In  tho  world  ol  mutttvartata  disf^ys  and  inteofal  dimensions  a  number  of  dtepiay  formats 
have  bem  etxplored.  Many  of  toeae  stodles  have  been  attemjpts  to  Integrate  irudlipie  dbiMnsioiiB 
M^thin  the  context  of  an  c^ect  or  (xn^giffal  (topiay.  Wlekeoa  (personal  communication)  hoe 
m^ggesied  that  the  rectangular  format  of  display  may  be  imkiiue  in  the  realm  of  object  dIapMye 
for  eeveral  reasons.  Rrst,  the  combination  of  width  and  h^ght  produces  the  emergent  and 
integral  feature  of  area.  Area  is  a  completely  Infegrd  combination  of  height  and  wicNh;  wHhoiti 
one  of  the  two  contributing  variables,  the  resutiant  (area)  ceases  to  exist  A  second  notion  Is 
tiiat  the  rectSnear  form  has  stMne  inherent  "goodn^”  (GestaH)  that  makes  ti  a  better  vehkle 
through  which  to  convey  formation  thid  one  may  wish  to  trtiegrate.  This  second  notion  has 
some  significant  urxfetpinftings  that  are  tied  to  the  environmertt  and  our  perceptutti  and 
cogttitive  developmefH.  It  is  thus  wortii  examtoing  some  of  tiie  cflspiay  work  p^ormed  to  date  to 
ascertain  how  the  results  may  have  been  kdluenced  by  some  fundaments  aspects  of  our 
perMptual  system. 

Consictorable  time  and  effort  have  been  invested  in  comparing  apples  with  oranges  in  the 
cttscusslot^  siffruunrting  compatibtitty  of  proximity  (Wkk^  and  Andre,  1988),  Integral  and 
separable  displays  (PurceH  artd  Coi^.  1988;  Sanderson  et  al.,  1^),  ar>d  figural  displays 
(Bertoger  and  Chrteman,  1987).  Berteatir  ati  of  the  higher-ievel  cognitive  factors  lies  a  very 
fundamental  factor  that  influences  aii  of  our  perception  regarcfing  our  envirorMnent;  experience 
wtih  horizontal  and  vertical  Urtes.  A  number  of  stocks  have  shown  that  responses  to  diagonal 
tines  in  the  environment  a'e  (tiflerent  from  those  to  vertical  ^d  horizontal  lines,  not  only  in 
humans  but  to  other  species  as  weH  (Appelie,  1972).  Some  of  this  »s  deveicpmentai  (Frye  et 

lOAn)  and  ReAn>A  largely  fn  rtisappA^r  with  axn«riftnoe/mati iration  while  other  effects 
peiaist  (Attneave  and  Tlamias,  1 977).  Those  effects  that  persist  seem  to  bias  the  organization 
of  the  world  into  horizontal  and  vertical  dimensions,  parlicuiarly  in  recall  of  spatial 
kdoimation  (^tneave  and  Thomas,  1977;  Beringer  and  Hancock,  1989).  This  bias  seems  to 
affect  our  inhererti  crgartization  of  the  wo^  and  ocx  expectations  ol  what  we  see. 
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of  Ms  logic  is  that  our  expectaUons  and  perceptual  developmant.  particidarty 
in  8  world  preponderance  oi  horizontai  fuul  verticai  Hnes  even  in  non-industrlalized 

ioaitpa.  are  i^tmed  to  the  tiortzontai  and  ver^caL  CorwequenUy,  having  people  use  triangiriar 
(or  ^ilar)  billed  jdsdays  wtwe  two  d  the  ddos  are  not  in  cratfonnance  with  a  rectflinear 
g^  nupr  be  trying  to  piM  a  trianguiar  peg  in  a  square  hole;  it  is  a  loose  fH  at  best. 

Sude^  and  &tndwson  (1989)  ex|:^ed  a  facet  this  issue  when  they  implemented  a  "right* 
triw^*  ds^ay.  This  da^y  ducted  deparbires  from  tK>nTial  system  operation  as  a 
departure  froin  vwUcal  d  one  of  ttw  skies  adjacent  the  normaSy  aOndef^ee  angle  (this  angle 
codd  vary).  They  found  performance  obtained  usfarg  this  trian^  superior,  frt  generd,  to  that 
dJtdnedwith  a  dniiia-  tris^ie  rotated  120  degrees  that  did  not  attgn  the  refermtce  an{^,  and 
thus  iwp  of  the  sides,  with  ^  horizontal  and  ver^cai.  Hence,  some  triangular  pegs  may  fit  the 
sc^iare  hote  better  than  others,  paiticdarty  if  dwy  are  perceived  as  half  dt  the  square. 

in  attempt  to  clarify  the  locus  d  these  expectations,  t¥ro  experiments  were  conducted  to 
measiure  9ie  completion  d  arndg^ious  "partiaJ*  geometric  figures.  The  figures  occurred  in 
codexts  that  were  hypothesized  to  irdiuertoe  ttie  form  in  which  the  figures  were  comiirfetad. 

Experiment  1:  Method 


St&igsta/Matffriahi  ./Progedufe 


The  subjects  were  undergraduate  psychology  students  enrolled  in  an  introductory*  psychdogy 
coisse  at  Mexico  State  Ur^versity.  There  were  a  total  of  16  studer^  who  paitdpated.  A 
booMd  codaining  8  orierriaiiors  d  ri^t-anj^  figures  was  used.  The  figures  consisted  of  the 
legs  d  a  right  irtein^  with  frte  hypotenuse  misdng.  Fot^  orientations  d  the  figure  were 
aSgrted  with  a  Cartesian  coordfrtaie  system  (die  edg^  d  the  page)  sudi  that  one  horizontal  and 
one  vertical  Rne  could  be  added  to  form  a  i^are.  The  other  four  orientadons  were  aHgned  at  45 
degree  anj^  to  a  Cartesian  coordinate  syst^  such  thd  the  addition  d  two  diagonally  oriented 
Sni$  were  necessssy  to  form  a  square.  The  eight  figures  on  the  frrst  Ibte  d  Rg^  1  labeled 
tiSgned  are  examples  d  frrese  two  types  d  stknuiL  Each  d  the  eight  dgures  was  Men  two  times 
fri  the  smaH  (3*  X  3.5”)  16  page  bookiet.  Subjects  were  given  the  booklet  with  written 
fristrucdons  to  "complete  the  geometric  figwe”.  Alter  reading  the  instructions,  the  subjects 
used  pen  or  pencH  to  complete  frie  16  figures  in  the  bookiet 

LI - iJ 

Figure  1 .  ITw  experimental  stimt^. 


Resuits/Discusslon 


Although  an  eqdvdent  lusuber  of  squares  and  triangles  were  expected  in  the  completed 
figures,  the  overall  rabo  appeared  to  favor  squares  regardless  of  orieniation.  The  question, 
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compldod  as  squetres  as  opposed  to  76  completed  as  triangles.  There  were  31  figures  completed 
bi  some  norwe^ar  manner  wdch  were  counted  as  iciscorable.  The  differences  were  rrot 
statlsticaBy  significant  because  of  Individual  variability.  This  means  that  different  people  are 
using  different  strategies  In  completing  the  task,  some  without  regard  to  the  experimental 


Second,  are  ttwa  more  "square”  pacpie  In  the  sampte  tfian  those  who  make 

Of  oi^  figures?  Yes,  to  a  barely  slgnlfirant  degree.  Six  resporKled 
squares,  2  responded  to  the  expeririwntal  n,anipulidlon,  1  made  triangles, 
neutr^,  Stfto  tNw  aMsre  unclassified.  Tifis  sms^  sanr^  i>ue  (16)  si^jgeetsd  that  a 
repficat^  be  used  to  increase  the  data  base  and  sort  out  these  effects. 

Experiment  2:  Mefitod 

SaWfifita/MatarbilB/f  rgggdurg 

The  aibjecte  were  imdergraduate  psychology  stodents  errrotied  in  an  inboductory  psychology 
coiffse  at  Nw  N^ex^  St^  UrriversHy.  Thwe  were  a  total  of  18  students  who  parfic^ed.  Tl^ 
matedate  were  firs  same  as  to  Experbnent  1  wfto  some  excepfiore.  Each  of  the  orfi^nal  figures 
was  presented  or^y  once  Unase  ^(ptt  figures  betog  presented  in  rvidom  order  in  toe  first 
haK  the  booklet  The  second  eight  figtaes  to  the  bockiet  coreisted  of  identicai  figiaes  which 
were  orimted  at  angles  midway  between  the  orientations  of  the  orlj^ta:  angles  if  toese  were  to 
be  arrac^ed  sequerifi^  (see  second  row  to  Figure  1).  Thus,  the  second  eight  figures  did  rwt 
conform  to  a  Cartesian  oowcHnate  systmn.  aHher  by  betog  oriented  with  the  H/V  axM  or  by  toe 
poesit^/  of  sapling  the  "pharfiom"  skie  of  the  with  toe  bnpUed  grid.  Subjects  were 

each  givm  a  bookiel  wM^  fhi^  oonipietod  to  toe  same  manner  as  to  E:\periment  I 

Resists  ^  EMscussion 

Data  were  coraMered  by  sttoudus  conrfition  (favoring  scprares;  favoring  triangles)  and 
percentage  of  squares  (bavm  was  used  as  toe  depeivdent  variabie  of  a  sto^factor  wfihin- 
sub^  design,  toe  percerrlsges  were  far  enough  from  the  extremes  that  the  normal 
approximation  appeared  justified  and  an  anidysto  of  variance  was  used.  Overali.  subjects 
produced  signUicanliy  more  scarves  when  stimuhffi  orisnfafion  favored  squares  (mean  of  72% 
versus  42%;  F(1,17)  «  8.7,  toasmuch  as  some  unscoreable  figu^  were  proeduced. 

the  percwSage  of  trfarvgies  produoed  was  tKrf  the  ooropiement  of  the  percentage  of  square.  A 
separate  an^yeis  tocficated  that  sut^ls  produced  a  ifignfiicanUy  larger  percentage  of  triangles 
when  sttonifus  oriefUation  favored  the  trtmgie  (mean  of  49%  vemrs  14%;  F(1.17)  «  11.74, 
p<.005].  to  addHion,  toe  mean  p«oer4age  of  sqtwes  produoed  to  toe  nortaiigned  (favortog 
nether)  corKlition  (fid  rwt  dKfer  stonMcantiy  from  that  expected  H  there  was  no  Mas  favoring 
eitoer  figure.  Thus  there  is  some  evidence  that  use  of  honzontai  and  verficai  tines  to  complete 
toese  figures  is  present  Actual  frequerKles  of  response  are  summarized  to  Table  1. 

Table  1.  Frequency  of  figurai  completion  by  category  for  Studec  1  arxf  2. 

STUDY  1  STUDY  2 


1 

Aligned  to  favor 

■ 

A 

TOTAL 

■ 

A 

^ErT>Bt 

TOTAL 

Figures  obtatoed: 

74 

76 

150 

52 

30 

76 

158 

A 

40 

36 

76 

10 

35 

59 

1 

f 

t 

104 

NETTWEfl 

15 

16 

31 

10 

7 

9 

f 

1 

wm^ 

26 

Si^iificant  subject  effects  suggested  examination  of  individiial  strategies.  Subjects  were 
subeequentiy  categorized  according  to  their  pattern  of  responses.  Those  categorized  as 
Yesporxlers"  had  at  least  75%  of  their  responses  iafUng  in  tt>e  category  predicted  by  toe  "use 
vertical  and  horizontd  fines"  hypothesis.  A  second  group  consisted  of  those  IndMduais  who 
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oUHte  d<^6s.  Oi  ftK>88  ramaininsi.  one  Individuai  {Mreterred  triangles  axclusiveiy. 
In  generai,  end  taro  could  ntit  be  classtfied.  Tt^  2  summattees  the 
o(  bKlMchtfM  for  both  stJdies.  Analysis  of  the  distrubufion  of  dasstfled 
catagbritiitkxifi  acrcas  studies  indicaled  i3.  neady  dgntOcant  departure  from  a  uniform 
rfisfrlbutkm.  (Rsferenoe  (3)  (v  <35  >  7^1;  obtained  ■  7.42). 


Table  2.  Calagortzailon  of  bxlMduais  by  response  sfrategy. 


Rtpondedte 

OiicnMion 

Mad* 

■ 

Made 

4 

Nautralor 

Othar 

LtodassiBed 

SIV’DY': 

2 

6 

1 

4 

3 

STUDY  2 

6  1 

s 

1 

2 

3 

One  frdere^k^  note  is  the  way  in  which  *re^»ndem‘'  performed  bt  tlw  nonaUprwd  trids; 
(our  were  aatftfvahmt  orw  made  predomlnantty  sqriares  and  one  madt:  predominartiiy  triangles. 
This  (tetr&adion  of  categorfzaliorui  suggests  two  strategies  that  are  here  hypothesized,  both 
iavoi^  Carteeliuv-cooidinate  responding.  The  first  strategy  involves  the  compieikm  of  figures 
using  horizontiif  and  vertic&t  lines  (*re^>ond»r*  bias).  The  second  strategy  Involves  the 
oompietkin  any  rig^  angle  as  a  r^  quadrUaterai  {*make  squares”  sbategy).  These  two 
dratogiee  appear  to  acoowd  (or  2/3  of  the  sampte. 

A  thfrd  sample  of  equK/alent  size  (IB)  was  very  recently  ooBectod  which  exhibited  a  much 
more  even  disfr^ion  of  responses.  Hie  dHference  fri  procedure  was  that  the  order  of  the 
two  fna)or  blocks  (aligned  and  normioned  idhnul)  was  reversed.  Thus  H  appears  that  temporad 
context  effK^  may  also  irdKienoe  respondng  to  some  degree.  The  present  sample  size  is  too 
smaB  to  eitow  much  qerwaiization.  however,  and  a  larger  repScatton  deeignad  to  sort  otd  some 
of  the  Elects  in  quiPS^  is  being  conducted. 

Condusiotie 

This  seriee  of  studies  suggests  th^  people  have  some  erqiactation  U»t  a  figure  containjng  a 
right  angle  wW  be  rec^Mnear  in  form,  not  frianguiar.  The  resufis  of  the  second  study  suggest 
that  a  deSnite  preference  existe  for  toe  use  of  hortzontai  and  vertlcai  Ones  in  completing 
geometric  figures.  Previous  shidies  have  suggested  that  people  acquire  qwfial  intormatkxi  and 
attempt  to  force  N  Onto  recfiSnov  form  eitoer  to  ease  toterpretallon  or  to  simplify  recait  (as 
seen  in  rectWnear  rwrraaiizaQon).  The  impfic^ion  for  spaW  dispiays  of  Informidton  is 
simple:  If  we  wish  to  sImpSfy  totorpretaOon  and  recal  of  kitormation.  it  may  be  to  our 
advantage  to  use  the  tohereni  quai)^  of  rectlinear  fmms  to  convey  the  inlormatton.  Wt^ 
this  may  Bmh  the  number  of  variabies  that  can  appew  In  a  stogie  reeffitoev  form  to  two,  orte 
may  also  consider  the  nesting  of  rectBtosar  forms  to  producs  higher<order  muitivailate 
dte^ys.  it  is  also  dear  that  indMduais  tovoke  stralegiw  to  some  degree  and  the  factors  which 
ddSsnntoe  toe  selection  of  a  strategy  need  to  b«  exambwd.  it  is  as  yet  urv:iear  to  what  extent 
spatial  dtaplays  may  be  affedsd  and  more  dada  is  needed  to  darify  some  of  the  issues  in  this 
area. 
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Abstract 

A  set  of  three  lights  flashing  either 
sitnoltaneously  or  sequentially  was  tested  as  a 
navigation  beacon.  The  temporal  interval  between 
sequential  flashes  required  for  the  perception  of 
non-simultaneity  averaged  about  10  msec.  The  change  in 
temporal  interval  required  to  see  a  difference 
increased  as  the  initial  temporal  interval  increased; 
it  averaged  about  18  msec  at  simultaneity  and  about  26 
msec  when  the  initial  temporal  interval  was  33  msec. 

The  O.S.  Coast  Guard  is  considering  several  novel 
navigation  aids.  Among  thftn  is  a  triplet  of  lights  which 
appear  to  flash  simultaneously  when  sailing  on  course.  When^ 
however r  the  ship  is  off  course  to  the  right,  the  right 
light  appears  to  flash  first,  and  when  the  ship  is  off 
course  to  the  left,  the  left  light  appears  to  flash  first 
(Brown,  1982).  The  asynchrony  would  alert  the  navigator 
that  be  was  off  course  and  in  which  direction;  he  would  then 
alter  course  until  the  lights  were  flashing  simultaneously. 

We  need  to  know,  however,  the  minimum  temporal  interval 
at  which  observers  reliably  recognize  that  two  lights  are 
not  simultaneous  and  can  accurately  judge  which  was 
presented  first.  Efron  (1963)  has  pointed  out  that  "it  is 
possible  for  most  subjects  to  be  aware  that  two  stimuli  ace 
not  simultaneous  but  yet  be  unable  to  identify  which  one  is 
first" . 


Several  studies  have  attempted  to  measure  the  smallest 
temporal  interval  needed  to  perceive  temporal  order.  Most 
are  not  applicable;  some,  for  example,  used  dichoptic 
viewing  (Robinson,  1967)  or  presented  the  two  stimuli  to 
different  visual  half-fields  (Corwin  and  Boynton,  1968; 
Efron,  1963;  Hirsch  and  Sherrick,  1961;  Lichtenstein,  1961; 
Rutschmann,  1966,  1973;  Sweet,  1953).  Many  reported  50% 
thresholds,  which  seems  inappropriate  for  the  present 
problem:  as  a  practical  matter,  we  cannot  be  satisfied  with 


a  judgment  which  iz  correct  only 
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Westheimer  and  McKee  (1977)  reported  the  study  most 
relevant  to  the  present  problem.  They  presented  two 
adjacent  linear  targets  to  the  fovea  and  found  that  temporal 
order  could  be  perceived  when  one  was  delayed  by  as  little 
as  3  msec. 


I  have  determined  the  temporal  interval  between  three 
light  flashes  which  most  viewers  can  perceive  with 
teasooahle  reliability  and  the  magnitude  of  navigatic^r;  error 
signalled  by  such  a  system. 


Method 


Subjects 

Tea  staff  members  of  the  laboratory,  ranging  in  age 
from  23  to  59,  observed.  All  had  20/25  or  better  visual 
acuity  with  a  correction  if  required. 


Apparatus 


The  obervers  viewed  three  lights  flashing  every  two 
seconds.  At  the  viewing  distance  of  6  m,  the  lights  were 
0.78  deg  apart  and  subtended  0.1  deg  visual  angle.  The 
flash  duration  was  about  50  nsec.  The  display  was  produced 
by  three  rotating  cylinders  (Fig.  1) . 


Fig.  1.  The  interior 
cylinder  on  the  left  rotates 
counter-clockwise,  and  the 
other  interior  cylinders 
rotate  clockwise.  The  first 
and  third  cylinders  rotate 
at  a  given  speed  and  produce 
two  flashes  for  each 
rotation,  while  the  second 
cylinder  rotates  at  twice 
that  speed  and  produces  one 
flash  per  rotation.  This 
produces  simultaneous 
flashes  when  viewed  head-on  and  sequential  flashes  when 
viewed  from  off  center.  The  interval  between  flashes 
increases  as  the  viewing  angle  increases. 


Procedure 


Thresholds  were  obtained  with  the  method  of  constant 
stimuli.  A  temporal  interval  was  set  and  the  flashing 
lights  exposed  until  the  observer  judged  whether  the  lights 
were  simultaneous,  or  the  right  or  left  light  appeared 
first.  The  lights  were  occluded  while  a  new  interval  was 
set,  and  so  on^  The  interval  at  which  the  observer  was 
correct  on  every  presentation  was  noted,  and,  in  addition,  a 
probit  analysis  was  carried  out  to  determine  the  interval 
perceptible  to  the  viewers  95%  of  the  time. 

Results 


Table  1  gives  the  mean  temporal  intervals  between  the 


adjacent  flashes  required  to  identify  the  temporal  order. 

Table  1 

Mean  temporal  intervals  (msec)  between 
adjacent  flashes  required  to  identify 
temporal  order  on  100%  and  95%of  the  trials 


100% 

95% 

Mean 

9.8 

8.4 

S.D. 

Upper 

4.4 

4.2 

Range 

16.0 

15.0 

Difference  Thresholds  for  Various  Disparities 

At  tiroes  the  navigator  will  be  off  course  when  he  first 
sees  the  beacons.  How  much  of  a  change  in  course  is 
required  before  be  can  detect  a  change  in  the  flashing 
display? 

Procedure 

The  display  was  exposed  at  a  viewing  angle  of  either  0, 
Ir  2,  4,  or  6  deg  to  the  right  or  left  of  the  center  line. 
These  corresponded  to  teroporal  intervals  of  0,  5.6#  11.1, 
22.2,  and  33.4  msec.  The  viewing  angle  remained  constant 
for  a  random  variable  period  between  5  and  10  sec,  after 
which  it  was  either  reduced  or  increased  at  a  rate  of  5 
deg/min.  The  subject  was  not  told  when  this  change  began  or 
in  which  direction  it  would  be  changed.  He  reported  when  he 
detected  a  change  and  whether  the  change  was  toward  more  or 
less  simultaneity. 

Results 

Figure  2  shows  the  mean  difference  thresholds  for  each 

Fig,  2.  Difference 
thresholds  in  minutes  of  arc 
of  viewing  angle  and  msec  of 
temporal  intergal  for 
different  initial  degrees  of 
off-center  viewing  and  for 
changes  toward  or  away  from 
simultaneity.  SI,  S2,  S3, 
and  S4  are  referred  to  in 
Fig.  3. 

starting  position  both  in  terms  of  the  change  in  the 
temporal  interval  and  the  viewing  angle  for  each  of  the 
starting  positions.  It  should  be  noted  that  these  are  the 
means  of  only  nine  observers;  although  all  reported  that  it 
was  a  difficult  judgment,  one  could  not  do  it  at  all  at  the 


,4  a|0<3  coaditiotts.  He  was  not  replaced  as  a  subject, 
■because  Ms  difficulties  constitute  an  important  statement 
this  type  of  navigation  aid. 

As  the  viewing  angle  of  the  starting  position  from  the 
center  line  increased  ^and,  therefore,  the  magnitude  of  the 
test^ral  interval  between  the  flashes  increased),  it  became 
significantly  more  difficult  to  detect  a  change  in  the  flash 
pattern  according  to  the  Friedman  Analysis  of  variance  by 
Ranks  (X^  *  11.2,  £  <  .01).  Judgments  of  decreasing 
temporal  interval  appear  to  be  easier  than  judgments  of 
increased  temporal  interval,  but  these  differences  were 
significant  (T  “  6/  P  <  -^^S)  only  for  the  4®  data,  according 
to  the  Wilcoxon  Hatcned-Pairs  Ranks  test. 

The  curves  are  not  monotonic. 

There  is  drop  in  the  thresholds 
around  1®  and  2®  after  which  they 
rise  continuously.  The  explanation 
seems  quite  clear.  It  is  diagrammed 
in  Figure  3.  There  is  a  range  of 
temporal  intervals  around  simultaneity 
which  a  given  subject  cannot 
discriminate.  {For  most  subjects  it 
is  1®  to  2®.)  VThcn  this  range  is 
exceeded,  he  does  detect  that  the 
flashes  are  not  simultaneous.  If  the 
starting  position  is  1°  off  center, 
the  resulting  temporal  intergal  is 
typically  too  small  co  detect,  but 
only  a  small  change  is  required  for  the  subject  to  respond 
that  the  lights  are  no  longer  simultaneous.  If  the  starting 
position  is  simultaneous,  then  a  larger  change  is  requit;id 
in  order  to  get  out  of  the  range  of  perceptual  simultaneity. 

If  the  starting  position  is  2®  off  center,  this  is 
typically  just  outside  the  range  of  perceptual  simultaneity. 
Thus  only  a  small  decrease  results  in  the  subjects  reporting 
simultaneity.  A  much  larger  change  is  required  if  the 
temporal  interval  is  increasing. 

Discussion 

These  times  must  be  converted  to  distance  measures.  For 
this  device,  a  12  msec  interval  corresponds  to  one  degree  of 
eccentricity  from  the  central  line  of  sight.  Thus,  if  an 
observer  requires  an  18  msec  interval  to  see  that  he  is  off 
course,  that  will  result  in  a  navigation  error  of  90  minutes 
or  arc.  at  a  urstaiiue  Oi.  xCuu  yai.\.s,  the  obetver  will  be  26 
yards  from  the  center  of  the  channel;  at  a  distance  of  5000 
yards,  he  will  be  131  yards  from  the  center.  Whether  this 
is  acceptable  of  not  will  depend  on  the  size  of  the  channel 
to  be  navigated. 


PERCEIVED  SIMULTANEITY 


2  10  12  3 

OEQREES  OFF  CENTER 


Fig.  3.  See  text. 
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Abstract 

Iwychophysicztl  requireaents  for  effective  three- 
dinenisional  {3-D)  auditory  displays  were  studied  in  a 
jiiaVtlAted  sonar  task.  Signal-to-noise  ratios  (SNSs) 
regtU.reil  to  detect  a  500  Hz  tone  in  broad-beuid  noise  were 
,i&eas^€ui  using  a  loudspeaker  array  in  a  free  field,  as  a 
^function  of  the  angulzu:  separation  of  the  sources,  the 
correlation  of  background  noises  coming  from  different 
sources,  and  listener  head  mov^ent.  The  SMK  decreased 
with  source  separation,  and  the  rate  of  decrezise  was 
Significantly  greater  for  uncorrelated  noise  theui  for 
partially  or  fully  correlated  noise.  The  results  were 
f^sentially  identical  when  the  listener's  head  was 
restrained  versxis  free  to  move.  Implications  for  the 
design  of  3-D  auditory  displays  ecre  discussed. 

The  idea  of  imparting  natural  three-dimensional  (3-D) 

^alities  to  sounds  heard  over  head^ones  has  recently  gained 
attention  as  a  possible  addition  to  man-machine  interfaces. 

Doll,  Garth,  Engelman,  and  Folds  (1986)  demonstrated  that 
acoustic  signals  delivered  to  a  listener  by  hctadphonca  cum  be 
sthde  to  sound  like  they  are  coming  from  s  source  some  distance 
from  the  listener.  The  sound  image  was  made  to  seem  fixed  in 
spa^,  even  though  the  listener  was  free  to  move  the  head.  A 
series  of  experiments  shoved  that  such  "virtual"  sound  sources 
can  be  locxitlized  with  accnirac:y  comparable  to  real  scxarces 
stimulating  the  unaided  ears. 

Digital  synthesizers  which  impart  3-D  qualities  to  auditory 
signals  cure  currently  being  developed,  and  prototypes  have 
alreadly  been  demonstrated  (e.g.  McKinley  and  Ericson,  1983) . 
Extensive  measurements  of  head-related  transfer  functions 
(KETF's)  have  been  made  at  the  University  of  Wisconsin  in 
cwilaboration  with  NASA  (Wightman  and  Kistler,  1989a) .  A 
synthesizer  based  on  these  functions  luis  been  demonstrated  at  the 
NASA  Ames  Research  Center  and  tested  at  the  University  of 
Wisconsin  (Wightman  and  Kistler,  1989b) . 

Although  digital  3-D  sound  synthesizers  are  now  available, 
relatively  little  is  known  about  their  psychophysical 
requirements.  To  date,  testing  has  examined  only  the  ability  of 
listeners  to  localize  a  single  sound  source,  in  most 
applications,  it  will  be  desirable  to  present  multiple  sound 


pctcnti.ally  serlOuS  iii  uiultlple— MOuice  3— D 


This  research  was  supported  in  part  by  a  C.  S.  Navy-ASEE  Summer 
Faculty  Fellowship  held  by  the  first  author  at  the  Naval 
Submarine  Medical  Research  Laboratory.  The  authors  are  grateful 
to  Dr.  J.  V.  Tobias  for  providing  resources  for  the  research,  and 
to  Ms.  Yvonne  Maszdcowski  and  Mr.  Edward  Thoma  for  their  support. 

323 


ilUiplayB  is  tliat  simultaaeous  inputs  from  different 
,dirii^d^s  siay  mask  one  another.  Obviously,  a  fundamental 
jrc<juireajent  is  that  each  signal  be  detectable  in  the  presence  of 
other  signals  that  are  presented  simultaneously. 

^he  present  s^.udy  examined  the  conditions  under  which 
list^exs  can  detact  a  signal  from  one  direction  when  other 
inputs  are  eimult^mco^l?.ly  presented  from  other  directions  in  a 
simulated  sonar  display .  The  signal  was  a  modulated  tone ,  which 
is  typigal  of  the  type  of  spectral  feature  used  tc  identify 
vuss^s  in  passive  sonar.  The  other  inputs  were  br^jadband  noise, 
which  simulated  sea  noise.  The  signetl  and  noie>,  inputs  were 
predicted  in  a  free-field  (i.e. ,  a  real  3-D  auditory  display) 
rather  than  a  synthesized  display.  The  results  are  therefore  not 
specific  to  any  particular  synthesizer,  but  represent  the 
performance  tiiat  could  be  expected  from  a  synthesizer  with  a  high 
level  of  psychological  fidelity. 

The  study  er?mined  three  aspects  of  3-D  auditory  displays:  (1) 
spatial  separation  of  the  sources,  (2)  degree  of  correlation  of 
the  noise  coming  from  the  varioxis  sources,  and  (3)  listener  head 
movement.  There  is  an  obvious  design  tradeoff  involving  source 
sepaxatiOK.  Sources  spaced  too  closely  will  mask  one-another, 
while  wide  source  spacing  might  tnmecessarily  sacrifice 
resolution.  It  seems  li)cely  that  the  optimal  separation  of  the 
cources  in  a  3-D  auditory  display  will  be  influenciid  by  the 
characteristics  of  the  signals,  such  as  their  correlation,  which 
could  be  manipulated  by  signal  processing  techniques  and  depends 
on  the  application.  Head  movement  was  manipulated  in  order  to 
assess  the  importance  of  head  coupling. 


Hatbod 


Seven  Couztic  model  882 2S  loudspeakers  were  arranged  in  a 
circular  arc  of  3.0  m  radius  centered  around  the  listener's  head. 
The  loudspeakers  vere  selected  so  that  their  amplitude  responses 
differed  by  no  tore  than  3  dB  from  0  to  20  )cHz.  The  responses 
were  flat  to  within  3  dB  oat  to  10  )cHz,  «md  then  rolled  off 
gradually.  Testing  was  conducted  in  on  anechoic  chamber. 

The  signal  was  a  500  Hz  tone  with  an  RKS  euaplitude  of  2  V  ac. 
The  tone  was  amplitude  modv^lated  by  a  10  L 3  sine  wave  with  an  RMS 
amplitude  of  3,5  V  ac  and  a  5  V  do  offst  .  The  signal  was 
presented  exclusively  from  the  center  lo^ .speaker.  It  had  20  ms 
rise  and  fall  times  which  followed  a  cosiiie-squared  function. 

Maskers  were  presented  from  either  the  center  loudspeaker 
alone,  or  from  the  center  loudspe^tker  and  two  others,  located  at 
+10,  ±20  or  ±40  degrees  from  the  center  loudspeaker.  The  single¬ 
speaker  condition  represented  the  limiting  case  of  0  degrees 
angular  separation  between  loudspeakers. 

Outputs  of  three  independent  white  noise  sources  vere  used  to 
produce  maskers  witli  specified  correlations.  The  spectrum  level 
of  each  masker  source  was  20  dB  (re;  .0002  dynes/ cm*)  at  500  Hz, 
measiured  at  the  origin  of  the  loudspeaker  array  vi  th  th**  1  i  stenar 
ed>sent.  With  throe  loudspeakers  active,  the  overall  masker 
spectral  levels  in  the  0.0,  C.8,  and  1.0  masker  correlation 
conditions  were  24.5,  27.5,  and  28.5  dB,  respectively.  The 
maskers  sounded  continuously  during  testing. 

Each  subject  was  tested  in  20  experimental  cond:.tions.  There 
vere  1C  Head  Restrained  and  10  Head  Mobile  conditions.,  defined  by 
all  possible  combinations  of  three  masker  correlations  (0.0,  0 
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loudspealcer  angles  (±10,  ±20  and  ±40  degrees), 
i6ne  '2^  condition  in  whi<^  only  the  center 

■  idspaeaifcir  was  active. 

-A^  adaptive  two-altemative  forced  choice  procedure  was  used 
to  estimate  the  signal  level  required  for  detection  ir.  each  test 
block#  which  included  60  test  trials.  Detection  levels  for  each 
condition  represent  averages  over  four  test  blocics.  The  sigiial 
rlevel  was  decreased  a  predetermined  step  size  after  every  three 
consecutive  correct  responses#  and  increased  the  same  step  size 
after  each  error,  which  constrained  the  percentage  of  correct 
Responses  to  be  7S.4  (d'«=l.l6). 

The  subjects  were  5  women  emd  l  man  between  the  ages  of  18  and 
41  years  with  normal  hearing  {  <  2C  dB  HL  at  octave  frequencies 
from  125  to  8000  Hz,  and  no  more  them  10  dB  interaural  difference 
at  any  test  frequency) , 


Results 


Figtires  l  and  2  show  the  signal-to-noise  ratio  (SNR)  required 
for  detection  in  the  Head  Restrained  and  Head  Mobile  conditions, 
respectively.  Three  major  trends  appear  in  both  figures:  (1)  the 
SHR  decreased  with  source  separation,  (2)  average  SNR  over  source 
separation  was  lover  for  0.0  masker  correlation  than  for  the  0.8 
and  1.0  correlations,  and  (3)  the  decrease  in  SNR  with  source 
separation  was  more  abrupt  when  the  xuusker  correlation  was  o.o 
them  when  it  was  0.8  or  l.O.  A  comparison  of  Figures  1  and  2 
shows  that  the  results  were  virtually  identical  for  the  Head 
Restrained  and  Head  Mobile  conditions  at  source  separations  up  to 
20  degrees.  Beyond  20  degrees,  the  0.8  correlation  condition 
showed  a  more  rapid  decrease  in  SNR  for  the  Head  Mobile  condition 
than  for  the  Head  Restrained  case. 

A  three-factor  repeated  measures  analysis  of  variance  (ANOVA) 
confirmed  the  first  three  observations  suide  above.  The  main 
effects  of  Source  Separation  and  Correlation  were  both 
statistically  significemt  {F(3,  15)  »  22.93,  p  <  .ool  and  F(2, 

10)  •  25.51,  p  <  .001,  respectively).  The  interaction  of  Source 
Separation  X  Correlacion  was  also  significant  (F(6,  30)  «  5.42,  p 
<  .001).  The  main  effect  of  Head  Movement  and  the  three-way 
interaction  of  Head  Movement  X  Source  Separation  X  Correlation 
were  not  significant  (F(l,  5)  =  0.02,  p  >  .05  emd  F(6,  30)  « 

0.94,  p  >  .05,  respectively).  None  of  the  remaining  interactions 
in  the  ANOVA  were  significant. 


Discussion 


The  results  show  that  signal  detectability  in  a  3-D  auditory 
display  is  better  with  uncorrelated  rather  than  partially  or 
fully  correlated  noise  sources.  They  also  show  that  increasing 
the  angular  separation  between  sources  produces  a  progressive 
release  from  masking,  i.e.,  an  decrease  in  the  SNR  required  for 
detection.  The  release  from  masking  with  source  separation  was 
more  rapid  when  the  noise  sources  were  uncorreiared  than  wnen 
they  were  partially  or  fully  correlated.  Head  movement  had  no 
effect  on  the  SNR  required  to  detect  the  signal.  This  result 
suggests  head  coupling  of  the  3-D  display  is  not  necessary  for 
the  detection  task  used  in  thi-  research. 

When  the  sources  were  40  de9rees  apart  and  the  masker 
correlation  was  0.0  the  SNR  needed  for  detection  in  the  3-D 
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Figure  1.  SNB  required  for  deteotlon  with  the  head  restrained,  as  a 
function  of  source  separation  and  masker  correlation. 


figure  2.  SNR  rsquired  for  deteotio.t  ■A’lth  the  head  mobile,  as  a 
function  of  source  separation  and  masker  correlation. 


325 


SB3 


^^‘‘  ■'  ’%•>'  . 


._;:  ^  ...  '■•- 


dB  le£^  that  in  the  single-source 

the  absolute  signaJL  level  needed  for 
about  2  dB  greater  than  that  required  when 
,|;^ly.a  e ingle  Idudspealcer  was  active.  Thus,  separating  the 
v^sph^ees  and  reducing  the  aaasker  correlation  reduced  but  did  not 
;'el:|wi4na^  3-D  display.  Obviously,  if  one’s  only 

vinteteat  were  in  iaproving  eighal  detectability  in  a  situation  in 
direction  is  known,  this  3-D  display  would  be 
■•ih^riPr  to  sihgie^aource  listening  (which  is  sixailar  to  auditory 
r'  diei^ays  in  submarine  sonar  systems) .  However,  3-D  displays  may 
other  important  applications.  For  esuuaple,  they  could  be 
v^ed  to  simultaneously  monitor  multiple  directions  for  new 
sig®^  Doll  and  Hanna  (1959)  reported  that  operators  were  able 
to  simultaneously  monitor  an  auditory  sonar  display  for  emy  one 
of  four  possible  signals  (i.e. ,  monitor  in  peurallel,  like  «in 
ideal  processor) .  3-D  displays,  which  allow  the  listener  to 

sii^tansously  monitor  multiple  directions,  might  therefore  be 
■superior  to  single-source  displays  in  which  the  listener  must 
scan  to  different  angular  sectors  and  listen  to  each  in 
stiiccession.  That  is,  the  the  mean  tine  to  detect  a  signal  from 
ahy  arbitrary  direction  mig^t  be  less  for  the  3-D  display  in 
spite  of  the  2  dB  disadvantage  in  signal  detectability.  3-D 
displays  may  also  offer  advantages  over  conventional  single- 
source  displays  for  other  types  of  tasks,  such  as  rapid 
dsssification  and  tracking  of  signals. 

The  present  results  show  that  the  sources  in  a  3-D  display 
must  be  widely  separated  (  >  40  degrees)  in  order  to  eliminate 
masking.  However,  the  variables  examined  in  the  present  study 
represent  only  a  few  of  the  signal  parameters  that  could  be 
manipulated  in  designing  3-D  auditory  displays.  Further  research 
is  xuieded  to  examine  additional  signal  parameters  to  find  ways  to 
further  reducing  masking  in  3-D  auditory  displays,  and  to 
determine  the  effectiveness  of  these  displays  for  tasks  other 
than  signal  detection,  e.g.,  discrimination  and  classification. 
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Abstract 

A  cridcal  issue  in  itfipleoxnting  R^ad  Conmionicatkm  Dii^lay  Techu^gy 
(RAI<XIM)  is  the  isamKr  in  adiidi  infomiaikn  is  initr^ed  or  edited  within  a  give^ 
di^jJay  settuebce.  ToevahiatB  some  pottcdal  infomanioa  cedii^  strategy  the  cunem 
sQidy  was  eooducted  in  whkdi  petfotmaaoe  (accumey  and  leacdon  tune)  <»  a 
BAKXyM  seand\/ nxmttcaiag  task  was  omqared  ei^  informatioQ  coding 

at  various  presentation  rates.  Results  indka^  significant  differences  in  both  accuracy 
and  ibaiotkw  tone  £»r  task  pciEfPrixance  using  die  different  c(x!cs  at  va^ 
dtoadoos.  This  data  efiEet^cly  pares  the.on|^  set  trfei^t  coding  concepts  down  to 
three-^kff.  fcHtt,  and  ^tttuiorienttnioo-^bat  yudded  the  bea  perforaxance  on  the 
RAPCOMtask.  These  rinduigs  represent  a  st^  towards  defining  effident  coding 
fornaats  for  future  i^HcatiriDs  of  RAPCC^  technoU^  in  opexarional  settings. 

An  advanced  visual  di^day  tedioology  has  been  developed  at  the  Annstmig  Aen>space 
Medical  Research  Laboratocy  based  tn  bidic  resoBch  that  used  inu^le  sequential  fian^ 
parathjpqos  fir  studies  of  visual  search  1086)  and  rapid  serial  visual  presentation 

(RSV!^  reading  (Potto:.  1084).  Ri^  Communiaititwi  Das^y  Technology  (RAPCOM)  is  a 
new  qiiroadi  (US  Pat^#4.MS.MS,  4  Jful  89)  fir  intptoving  infonnation  transfer  in  visual 
dii^lays.  In  essence,  RAPCQht  is  a  di^yscfaecoe  based  on  the  ability  of  human  observers 
m  efirecdvely  proc^  infonnadon  presented  in  ntpid  cestiporal  succession  within  a  single  spatial 
locarion.  (Sre  Figure  1.)  As  ar^ilt,  the  needfor  sacca^  eye  movements  is  eliminated, 
yielding  a  signified  savings  in  time  for  tnfonnadon  transfer  that  may  be  cridcal  to  users  (e.g^ 
fi^iter  pilots)  operating  at  ^  limits  their  sensory  c^tabOides.  In  ract.  Matin  and  Boff 
(1988)  have  reported  RAPCX>M  savings  fixxn  two  to  five  dmes  over  comparable  ctmvendonal 
di^lay  anays.  In  sum,  RAPCOM  technology  c^ers  the  designer  several  potential  advantages 
ovocouventioaaldisi^y  iQ^proaches;  enhanced  speeded informadon  tracer  for  sosne  types 
of  infonnation  proce^g;  reduced  ^lace  requirements  for  the  di^lay,  since  several  piec«  cf 
indc^ieodent  infonnadon  can  be  ptesoited  by  a  sin^  RAPCOM  window;  ccmnolover 
infoitnadon  sanqding  sequences,  which  can  encourage  superior  disiday  tnooitoring  strategies; 
and  ease  (tf  in^emeatadon  in  operational  environments,  where  displays  are  already  largely 
computer  driven  (Madn  and  Boff,  19^). 


Figure  1.  A  conventional  display  with  three  windows  and  the 
ccHtespooding  RAPCOM  display  (not  to  scale). 


While  ]nevious  research  effcxts  have  dononstrated  that  RAPCX>M  technolo^  is  a  viable 
concept  (Maxis,  Boff,  and  Dooovan,  1987;  Mads  and  BoS,  1988;  Osgood,  Boff,  and 
D(Hiovas.  1988;  Payne,  1988),  its  feasitality  for  ^iicaiu»  in  complex  system  environments 
remains  to  be  shown.  The  l^  to  successful  ^plication  of  RAPCOM  tedinology  lies  in 
whether  or  not  the  infonnation  presented  can  be  poitra)^  so  that  successive  frames  can  be 
independenily  discriminated  by  the  systan  user.  A  critical  issue  hoe  is  the  manner  in  which 
the  infonmatioc  in  a  given  fraiw  is  poitra)^  or  coded  with  respect  to  any  otirer  frame  of 
information  in  a  RAPCDM  sequence.  In  other  words,  infe^mation  is  not  adequately 
"coded",  it  will  IDtely  appear  to  the  system  operator  as  a  meaningless  juml^  of  letters  and 
numbers.  A  coding  strategy  is  needed  that  will  cqjtimizc  the  usefulness  of  RAPCOM-jarscnted 
infonnation  and  enhance  its  potential  for  q}erad<»al  crew  system  applications. 

A  review  of  die  coding  literature  revealed  that  for  nonnal  adults,  language  as  a  code  or 
format  takes  |»ocessing  {mority  over  all  odieis  because  of  its  vast  overieaming  (Teichner, 
1979).  Thus,  linguistic  and  ctmtextual  cues  may  satisfactorily  act  to  code  some  types  of 
information  (Chen,  1986).  However,  when  the  inftnmadon  presented  consists  of  nunreric 
values  or  sets  of  related  variables  (e.g.,  in-flight  parameters  in  a  cockpit  environment), 
contextual  coding  alone  is  unsatisfactory.  Several  mher  coding  alternatives  itave  been 
suggested:  colcur  of  a  single  item  or  segment  of  data,  brightness  contrast  of  certain  pieces  of 
information,  symbols  or  shape  coding,  alphanumerics  ai^  different  types  of  fonts,  size, 
flashing  of  an  item,  inverse  video  of  rield  and  ground,  line  type,  and  redundant  coding,  which 
may  enhance  the  efrects  of  individual  coding  schemes  (Narborough-  Hall,  1985;  Chrik,  1975). 
Alone  or  in  combination,  several  of  these  co^g  concepts  may  be  feasible  for  incraporarion 
into  a  RAPCOM  scheme. 

The  (^jeedve  of  this  study  was  to  ccRnpare  several  potential  information  coding  strategies 
within  a  RAPCOM  paradigm,  and  to  select  three  or  four  that  showed  the  greatest  promise  for 
furore  rcscareh.  Ei^  coding  conditions  were  developed  to  help  subjects  discrimiruic  frames 
of  infcHmadon  witlun  RAPCOM  trials.  In  the  "label"  condition,  each  RAPCOM  frame  had  one 
of  four  labels:  "A",  "B",  “C",  or  “D".  In  the  "frame  color"  condition,  the  sunounding  area  of 
each  frame  was  coltHtd  one  (tf  four  colors:  cyan,  pi^  yellow,  or  red.  In  the  "text  cdor" 
coTKiitioa,  the  border  of  each  frame  and  the  text  within  each  fra:^  were  cc^csed  one  of  four 
cdors;  blue,  red,  green,  or  black.  In  the  “font"  condidoo,  the  text  within  each  fran^  was 
di^layed  in  one  cl  four  fonts:  italic,  bold,  underline,  and  shadow.  In  the  "background 
pattern"  condidon,  the  surrounding  area  of  each  frame  contained  one  of  four  patterns: 
hc»iz<Mtal  Unes,  diagonal  lines,  dots,  and  checker  board.  In  the  ‘frame  shape"  condidon,  each 
frairte  had  one  of  four  shapes:  triangle,  rectangle,  dianoond,  and  oval  Finally,  in  the  "slmdal 
offset  1 "  and  "spatial  offset  2"  condidons,  each  frame  was  offset  sli^tly  from  the  cenrer  point 
of  the  di^lay.  The  difference  between  these  two  conditions  was  that  one  displayed  a  central 
focal  point  and  the  other  did  not  Previous  RAPCOM  studies  used  rcctangui^  frames  with 
black  benders  and  text,  and  a  white  sunounding  area. 

Method 


Suiziffias 

Four  subjects,  two  females  aitd  two  females,  ages  22  through  29,  pardcipated  in  this 
experiment  fw  five  sessions.  All  subjects  reported  having  non^  color  vision  and  20/20 
coiTtcted  visual  acuity,  and  were  right-hand^  AH  subjects  had  prv  aous  experience  with  the 
RAPCOM  paradigm,  and  received  five  training  sessions  on  this  pardcular  task. 

Agparaius 

This  study  was  conducted  in  the  Design  Effectiveness  Technology’  (DEfTcch)  Laboratory  at 
the  Harry  G.  Armstrong  Aerospace  Medical  Research  Laboratory,  Wright-Patterson  AFB,  OH. 
An  Appk  Macintosh  II  laboratory  cOTifniter  system  with  an  enhanced  cdor  graphics  mcaiitOT 


provided  overaU  Mxiiroi  of  sdmy  US  presctmukw  and  dau  acquisidoiL  I^gsamming  was  done 
^imarily  u  HyperCard,  with  X  CoDQinaad  supplements  writtoi  in  C  The  respo^  panel  was 
a  standard  keyboard,  placed  tm  a  oxiqntter  taUe  in  front  of  the  seated  subject.  Four 
response  were  designa^  with  the  lab^  A,  B,C  and  D.  Sutyects  were  pCTiitted  to 
choose  whi(^  hand  and  frni^  would  operate  the  ke^  The  crnninner  receded  accinacy, 
reactitm  time  in  nriliiseconds,  and  also  recorded  which  keys  had  been  pressed.  This 
infonnaticni  and  caher  smstnary  data  woe  primed  out  on  an  Apple  LaserWriter  n  inanediately 
following  each  sessum.  so  the  experimenter  ccmld  monitor  the  subject's  pexfonnance  between 
sessions. 

Procedure 

The  experimental  design  coosi^ed  of  two  witfain-subyect  factors,  coding  condition  and 
di^layqiod.  In  total,  subjects  ran  ei^t  coding  conditioas  at  frve  display  speeds.  Coding 
condidocs  included:  labeL  frame  col«’.  text  colw,  background  pattern,  frame  shape,  font,  and 
two  conditions  in  which  frames  were  slig^y  offret  spad^y.  The  frame  d^lay  times  used 
were:  250  ms,  200  ms,  ISO  ms,  100  ms,  and  SO  ms.  Befcae  each  run,  subjects  had  up  to  five 
minutes  to  memorize  die  code  that  was  in  e^ctfra-diat  run.  The  stitmiii  consisted 
RAPCOM  frames  containing  duee-digit  numeric  values  ranging  from  000  to  999,  with 
200-800  cmisidered  **in-bosutds'*.  Four  arintrary  parameters.  A,  B,  C,  and  D,  were  defined  to 
comespemd  to  the  four  frames  of  infonnadonpresmted  in  each  trial  In  an  operadonal  setting, 
these  parameters  would  be  meaningful  (e.g..  air  speed,  ahitode,  etc). 

Subjects  were  told  that  their  task  was  to  mpoixi  as  quickly  and  as  accurately  as  poss^e  to 
out-of-txmnds  values  presented  during  RAPCOM  trials.  They  were  instructed  to  determine 
which  of  four  values  presented  per  trial  was  out  of  the  preset  boundaries,  and  to  identify  which 
of  the  four  constant  parameters  that  value  cocresponded  to.  For  exan^le,  in  the  "frame  color" 
condidon,  a  cyan  suiTOundccBTesponded  to  parameter  A,  a  red  surround  to  parameter  B,  a  pink 
surround  to  paranxter  C,  ajod  a  yellow  unround  corresponded  to  parameter  D.  Responses 
were  given  by  first  pressing  TExuer"  to  acknowledge  that  a  value  was  out  of  bounds,  then 
pressing  "A",  "B",  "C",  or  "D"  to  identify  which  parameter  was  out  of  bounds,  and  finally 
pressing  'Tnter"  again  to  sigiul  diat  the  respcxise  was  completed.  Reacdcm  dines  for  all  three 
button  presses  were  recorded. 

Subjects  ctxt^leted  five  one-hour  experimental  sessiens.  Scsstons  consisted  of  twenty- 
four  runs  of  tra  tx^  eacb-a  total  of  240  trials  per  session.  Within  each  session,  the  order  of 
condidons  was  randomized.  Within  each  trial  the  order  of  parameters  presented  was 
randomized.  Also  within  each  trial  the  three-dgit  values  were  randomized  between  000  and 
999,  with  one  the  four  values  being  out  of  bounds.  All  trials  were  scored.  Each  run 

consisted  of  a  three-second  ready  signal  fidlowed  by  ten  cycles  (trials)  of  four  RAPCOM 
frames.  The  run  would  not  continue  uiml  the  subj^  made  three  key  press  responses 
follow^  each  ttial  Subjects  received  feedback  regarding  their  reaction  times  and  accuracy 
following  each  run. 


Results 

A  rqieated  nseasures  analysis  of  variance  was  conduaed  to  assess  the  effects  of  frame 
duration  and  coding  conditicn  on  accuracy  (%  correct)  and  leacticm  time.  Reaction  time  values 
used  fix'  analysis  were  calculated  by  adding  the  reaction  times  for  the  first  two  button  presses 
for  each  trial  representing  the  cognitive  portiwi  of  subjects'  responses.  For  F-tests  involving 
more  than  one  degree  of  freedom  in  the  numerator,  the  Greenhouse-Geisser  degree  of  freedom 

>  >■»»»»*  «-«  MMI 

The  effect  of  frame  duration  on  reaction  time  was  significant,  £  (1.5, 4.5)  =  39.34, 

P  <  .002,  as  was  the  effect  of  fi-amc  duration  on  accuracy,  £  (U,  4.5)  =  70.30,  p  <  .001.  As 
frame  duration  decreased,  reaction  time  increased  and  accuracy  decreased,  indicating  that 
RAPCOM  performance  was  better  at  slower  display  speeds.  Sec  Figure  2. 
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E  (L6. 4.7)  =  1157,  ft  <  .016,  «Dd  the 
i.E<lJ5,4.‘j0=*? 24.61, ft <.001,  Codedidnot 
timeariccuiacy.  Paxi^coD^snsOTSweseuscd 


4iaK$P0P  code  wu  tigafiunriy  skrwer  dun  all  odier  codes,  s  <  .044. 

^ycBa^4  thghfsd^^BQBod,  label,  aodfiaaae  shai)e  codes  wac  si|mficantly  accurate 
d»a  d)efb«od>er  co^  a  <  JB3.  See  3. 
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Hpge  3.  Effect  of  <x>ding  sdiemes  OQ  reactioo  time  and  accuracy  peifarinance 
measures  uaii^  RAPCXIM  displays. 

Discusstoo 

The  initial  hype^hesis  was  dun  certain  cedes  would  be  more  intuitive  to  Jearn  and  use,  and 
c^iiSCQuestiy  would  be  effective  for  coding  informsdoo  in  RAPCOM  di5”i2i''S.  r^ai-a 
analysis  supports  this  hypothesis,  finding  significam  differences  Ixnwecn  codK  in  terms  of 
petfoimance^iaxuracy  wd  reaction  time.  Ilte  frame  color,  texteokv,  font,  and  two  spatial 
orientation  codes  prov^  to  be  the  most  effective,  while  the  background,  lal^  and  frt^  shape 
codes  were  least  dffectxve  in  facilitating  RAPCCM  performance.  Furdier.  these  five  effective 


codes  can  be  coliaiued  into  three  general  coding  strategies:  color,  odencaxion,  and  fcmt 
Foidiericseandi  CNi  coding  issues  wiU  cmqjare  variations  of  die»  three  roost  pronaising 
coring  strategies,  which  huhlkated^  fastest  reactioD  times  at  the  foster  (h^lay  speeds, 
yielded  die  higiu^  accuracy.  The  focus  of  die  next  study  will  be  to  further  narrow  and  define 
the  feasil^  coding  approaches,  examioe  the  efiects  of  redundant  coding,  and  uifixoately  select 
w  optimal  RAPCX)M  coding  fcoxraL  Other  lir^  of  research  planned  for  this  technolo^ 
include:  (a)  evaluating  the  ^ect  of  RAPCX^  coding  schemes  in  dual>task  paradign^  and  (b) 
testing  the  effects  o(  high-g  acceleati(»  on  RAPCOM  performance  in  a  dynamic  environment 
sitnalator. 

Potential  i^^ilications  for  RAPCX>M  technology  incintk  militaiy  crew  stations,  air  oafflc 
control  centers,  nuclear  iwwer  plants,  ^lace  stations,  and  any  other  complex,  computer- 
controlled  systnns  in  w^b  human  opoatars  must  receive  and  manage  large  amounts  of 
infosmatioQ  (Matin  et  aL,  1987).  However,  fiill  realization  of  this  potential  is  contingeiu  upon 
defining  an  effidem,  effective  RAPCOM  coding  format  This  data  effectively  pares  the 
original  set  of  eig^  codes  down  co  throe  coding  stiatcgies-colOT,  font,  and  spa^ 
odentatbn-that  yielded  the  best  performarice  mi  the  ^APCOM  task.  Thus,  these  findings 
rqxesmt  a  step  towards  applying  RAPCOM  tedinology  in  qieiatmnal  settings. 
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THE  EEWmOU  GF  CEIimL-VIStAL  OVESLOAB  IN  THE  COCKPIT 


Elsa  F.  Ueiflsteta,  Fh.D. 
University  o£  Illlftoia  at  Urbana-Chaa^gn 

Abstract 


A  tiae~aharlng  experlaent  i-'  .^tigated  the  use  of  noQ> 
traditlocal  flight  displays  for  tae  reduction  of  central-visual 
overload  in  the  cockpit.  The  possibility  of  a  coapatibllity 
oapping  between  the  type  of  task  and  the  presentation  location  of 
the  task  in  the  visual  field  was  also  explored.  The  results 
indicate  that  a  non-traditlonal  flow-field  display  allowed  for 
accurate  control  and  the  aost  efficient  tiae-sharing.  Limited 
evidence  was  found  to  support  a  c<»patibllity  hypothesis. 


The  increasing  coaplexlty  of  technology  found  in  the  aircraft  cockpit 
has  draMticallj  increased  the  ccaber  of  displays  from  which  a  pilot  aust 
extract  ' inf ozsaticm.  An  a  result »  the  central  vision  of  the  pilot  has  becoae 
ovu^loaded  vhich  could  lead  to  decision  aaking  errors  and  Increase  tl» 
potential  for  accidents.  The  experiaent  to  be  described  tested  two 
pcaeifailitiet  for  redudog  central-visual  overload.  Based  on  the  relative 
strengths  of  central  and  perlidieral  vlsloa,  the  first  possibility  Involves 
off-loodiag  aoae  visual  taaks  to  perlidieral  vlsiot.  It  Is  well  established 
that  with  retinal  eccentricity  action  sensitivity  is  regraded  leas  rapidly 
than  acuity.  One  hypothesis  in  the  currant  research  was  that  whan  central 
vision  is  overloaded  and  vlaual-spatial  taaks  are  to  be  off-loaded  froa 
central  vision,  perforaance  on  aotion-taaks  will  be  degraded  less  then 
perforaance  on  object-recognition  tasks. 

Leibowlts  (1986),  in  presenting  a  dlchotoay  between  focal  and  aablent 
vision  suggested  that  a  wide  field-of-vlev  Including  peripheral  vision  is 
best  suited  for  action- judgaent  tasks,  and  that  ^en  presented  in  this 
asnner  aotion  ta&ks  can  be  perforaed  with  few  procesaing  resources. 
Leibowltz's  theory  would  suggest  that  peripheral  vision  would  be  better  at 
tracking  and  at  tiae-sharing  than  central  vision. 


The  secosid  aethod  suggested  for  reducing  central-visual  overload 
involves  the  use  of  non-traditlonal  flight  displays.  The  current  study 
exaained  the  use  of  peripheral  vision  and  flow-field  displays.  The  \ise  of 
peripheral  vision  horizon  displays  (FVHD)  has  been  widely  discussed  and  a 
variety  of  attitude  Indicator  displays  for  aircraft  have  been  designed  and 
tested  using  this  channel.  Baaeluck  (1988)  presents  a  critlceU.  review  of 
the  literature  on  the  PVHD.  If  these  displays  are  effective,  they  would 
provide  an  alternative  method  for  presenting  attitude  icforaation  to  a  pilot 
while  reducing  central-visual  load. 


^  as  9  m  9  w  ^  ^  ■■  ow  wr4  T  T  S*  Wa 

flow-field  If  it  meets  three  criteria:  1)  extension  across  the  central  and 
peripheral  visual  fields;  2)  presentation  of  information  in  a  way  that  Is 
pictorially  consistent  with  the  information  available  in  the  real-world; 
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■S)  of  characteristics  of  displays  i<hich  have  been  called 

<!i.e. .  splay  and  cospresslon.  see  Gibsoo,  1979).  The  symbology 
i|t'  thb  f^v-fi^ld  display  was  designed  in  part  baaed  on  Roscoe*s  (1968) 
prifieiple  of  pictorijU^  really.  So8Coe*s  idea  suggests  that  realistic 
pictiu^s  require  less  interpretation  and  proceasixig  (or  in  Gibson's  terns, 
direct  perception)  and  should  titerefore  require  fever  processing 
ri^urcea.  The  experinent  examined  the  attentlonal  demands.  In  a  dual-^task 
flight  simulation,  associated  with  the  use  of  non-tradltioaal  displays. 

Method 

hisplars 

Three  experimental  displays  vere  employed  vhicb  are  pictured  in  Figure 
1.  The  figure  Illustrates  tte  three  displays  shoving  high  altitude,  and  a 
right  bank  with  the  aircraft  heading  right.  The  first  display  is  a  central 
display  similar  to  a  traditional  attitude  Indicator,  except  t^t  the  current 
central  display  waa  outside/in  or  world  referenced.  Ac  horizon  line  was 
located  in  the  center  of  the  display  and  extended  the  width  of  the  flight 
envelope.  The  task  was  to  maintain  the  symbol  upright  and  on  the  center  of 
the  horizon  line. 


ripir«  t  :  01«pla7«  tll«MT*cla(  reliint  rt(Kt,  )>l|h  altltHd* 

aai  rtfkt  •(  cmtm. 

The  second  display,  sho%ni  in  Figure  lb,  vas  a  peripheral  display.  The 
display  consisted  of  two  crosses  located  20  degrees  of  visual  angle  apart. 
Behind  each  croas  (during  level  flight)  vas  an  horizon  line  that  extended 
the  width  of  the  flight  envelope.  In  order  to  anlntain  straight  and  level 
flight,  subjects  bad  to  maintain  both  crosses  centered  on  the  horizon  lines. 
The  task  required  that  the  subjects  view  both  crosses  simultaneously  which 
could  only  ^  accomplished  with  peripheral  vision. 

The  third  display,  aho.  ■  in  Figure  Ic,  was  a  flow-field  display.  The 
display  provided  splay  and  c  pressioc  information  in  the  fora  of  horizontal 
linM,  and  a  full-Held  hori^ija  lins;„  Altitude  information  vas  available 
from  the  changes  in  the  splay  angle,  as  veil  as  from  the  distance  between 
the  horizontal  lines.  The  task  was  to  maintain  straight  and  level  flight  at 
an  altitude  displayed  at  the  beginning  of  the  trial. 

Flight  task 

The  flight  task  consisted  of  a  two-axis  compensatory  tracking  task. 
Subjects  were  asked  to  maintain  straight  and  level  orientation  while  being 


.■■  .v-^- •  -  - 

:.  by  paeudo-raadtat  wind  gusts.  During  each  of  the  three 

■  subjects  coopleted  10  trials.  Trials  lasted  four 

'  ' ',  ■  ' ■  ^  diUrifig  which  iutbjecta  hovered  as  opposed  to  aoving  through  the 

Subjects  controlled  altitude  through  pitch,  and  heading  through  roll 
order  control  dynaaica.  Root  mean  square  error  in  tracking  was 
j,.  .  '  ^  as  well  as  root  mean  square  control  velocity. 

V'  Secondary  tasks 


While  flying,  subjects  periodically  perforaied  one  of  two  secondary 
tasks,  an  ohject^recognition  task  and  a  tsoticm^dlscrittittation  task.  In  the 
obje^-recognltlon  task  subjects  were  asked  to  identify  one  of  two  shapes 
(i.e.,  a  square,  a  diamond  and  a  triangle)  which  appeared  either  in  the 
center  of  the  display  or  at  both  of  the  peripheries  for  500  msec. 


Ihe  ffiotion'Kliscriainatioa  task  was  in  most  ways  directly  analogous  to 
the  cbject->recognition  task.  Two  rectangular  windows  filled  with  random 
dots  appeared  either  side  by  side  in  the  center  of  the  display  or  at  the  two 
peripheral  locations  of  the  display.  The  dots  in  the  windows  ware  either 
aoving -down,  not  aoving,  or  aoving  up  on  the  display.  Ihe  duration  of 
presentation  of  the  stlvili  was  500  ssec.  Subjects  were  asked  to  indicate 
the  direction  of  motion  in  one  of  the  two  windows.  Accuracy  and  reaction- 
tiae  to  classify  the  events  was  recorded. 

Apparatus  and  subjects 


The  ezpezioental  displays  and  the  secondary  tasks  were  presented  on  a 
Silicon  Graphics  S020  IRIS  coaputer  systes.  A  high  resolution  (1024  x  768 
pixels)  color  Monitor  presented  the  displays.  Subjiects  were  seated  such 
that  the  oKinltor  subtended  a  visual  angle  of  31  (horizontal)  x  24  (vertical) 
degrees*  Flight  control  was  Input  by  using  a  2-axi8  spring-loaded 
displacement  stick.  Responses  to  the  secondary  tasks  were  Input  by  a 
keypad.  Thirty  right-handed  male  students  from  the  University  of  Illinois 
volunteered  as  subjects,  and  ten  trere  assigned  to  each  display  condition. 

All  were  flight  naive,  and  reported  normal  or  corrected  to  normal  vision. 


Results 


Flight  data 


The  root  mean  square  (RKS)  errors  (altitude  and  heading)  and  the 
control  velocities  (^titude  and  heading)  were  recorded  during  single-task 
and  dual-task  flight  trials.  HANOVAa  were  conducted  on  these  measures  to 
assess  the  differences  in  time-sharing  performance  with  the  four  secondary 
tasks  and  the  three  display  types.  In  RMSE  altitude,  there  was  a  small 
advantage  for  the  central  display  (F(2,27)-3.25,  p«.054),  relative  to  the 
flow-field  display  (see  Figure  2).  The  RMSE  heading  analysis  revealed  a 
significant  task  type  by  location  interaction  (F(l,27)-5.35,  p<.0S)  (see 
Figure  3).  Wien  the  tasks  were  presented  centrally,  they  effected  flight 
performance  equally.  Bovever,  when  presented  in  peripheral  vision,  the 
shape  tasks  produced  significantly  greater  decrM«nts  in  flight  performance 
than  the  motion  task. 
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•tbeltMS  cofttxol  activity  (altitude)  analyala  showed  a  sigaif leant  aain 
effect  of  display  type  (F(2,27)«19.52,  p<.00r).  In  order  to  achieve 
accurate  coctrol  with  the  central  display  large  control  actions  were  needed 
(see  Figure  4).  Much  saialler  control  actiojis  were  needed  with  the  flow- 
field  display. 

Secofldary~task  data 

The  MAHOVAs  on  the  accuracy  decreaent  scores  revealed  that  the  location 
of  the  task  has  no  effect  on  accuracy  with  the  central  display,  but  has  a 
significant  effect  with  the  peripheral  (F(i,9)»*9.41,  p<.05)  and  flow-fiald 
displays  (F(l,9)'»5.87,  p<.05).  With  the  latter  two  displays,  a  central- 
secondary  task  resulted  in  aaaller  accuracy  decraaenta  than  a  peripheral- 
secondary  task.  The  absence  of  a  difference  with  the  central  display 
suggests  less  interference  between  two  central  tasks  than  between  two 
peripheral  tastks. 


Conclusions 

Several  general  conclusions  can  be  drawn  from  the  previous  discussion. 
First,  tasks  presented  in  peripheral  vision  are  consist^tly  more  difficult, 
whether  they  involve  shape  or  motion  discrimination.  This  finding 
contradicts  previous  suggestions  that  peripheral  motion  processing  required 
few  if  any  resources.  Second,  central  and  peripheral  vision  do  not 
constitute  separate  resources.  If  they  did,  then  time-sharing  one  central 
and  one  peri|^eral  task  would  produce  the  beat  performance.  The  current 
results  showed  two  central  tasks  producing  the  beat  time-sharing.  Third, 
the  8MSE  heading  data  suggest  that  when  off-loaded  to  peripheral  vision  the 
motion  task  interfered  lees  with  tracking  than  did  the  shape  task. 

Finally,  although  the  central  display  resulted  in  the  best  single-task 
altitude  control,  the  flow-field  display  was  found  to  be  superior  to  the 
central  and  peripheral  display  in  several  ways.  The  flow-field  display 
allo««ed  for  fairly  accurate  control,  reduced  control  activity,  and  very 
efficient  time-sharing.  Future  research  will  ftirther  investigate  the  use  of 
flow-field  displays  as  a  possible  solution  to  central-visual  overload  in  the 
cockpit. 

This  research  was  funded  by  a  grant  from  NASA  Rotocraft  Human  Factors 
Research  Branch  (Contract  No.  NAG  2-308).  Sandra  Hart  was  the  contract 
monitor. 
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Knowledge  Acquisition  in  Building  Expert  Systems; 

Aj^lying  the  Hunian  Factors  Perspective  to  Achieve  a  Principle-Driven 

Process 


Captain  uay  A.  Horn 
USAF  Academy 


Abstract 


This  paper  examines  the  problem  of  knowledge 
acquisition  in  the  development  of  expert  systems.  While 
many  of  these  expert  systems  have  been  billed  as  possessing 
the  capability  to  robustly  cope  with  the  demands  of  their 
particular  domains#  the  litera.ture  reveals  that  often  these 
systems  are  less  capable  than  expected  by  the  expert  system 
designers,  often  due  to  problems  during  knowledge 
acquisition.  This  paper  proposes  a  principle-driven 
process,  based  on  human  factors  principles,  of  knowledge 
acquisition  for  building  expert  systems. 

The  science  of  artificial  intelligence  and  its  related  sabfields 
of  expert  systems,  robotics  and  machine  vision,  and  natural  language 
processing  have  recently  exploded  into  the  forefront  of  scientific 
and  engineering  research  and  applications.  Expert  systems,  defined 
as  knowledge-based  systems  that  emulate  expert  performance  to  solve 
significant  problems  in  a  particular  domain  of  expertise  (Sell, 

1986),  are  currently  receiving  a  great  ueal  of  actention. 

Because  of  this  interest  {and  increased  hunian  factors  interest, 
see  Wheeler,  1969),  the  potential  benefits  expert  systems  possess, 
and  the  failure  of  expert  systems  technology  (in  general}  to  live  up 
to  this  potential,  it  is  appropriate  to  examine  how  expert  systems 
are  built  and  how  the  proces'j  can  be  improved.  This  paper  examines 
the  basic  process  of  how  expert  systems  knowledge  acquisition  is 
conducted,  with  recommended  improvements  of  that  design  process  in 
light  of  the  huican  factors  perspective. 

Problem  Statement 


Despite  the  claims  of  their  developers,  taany  expert  systems  havs 
yet  to  realize  their  potential  as  useful  domain  experts  that  provide 
useable  knowledge  to  system  users.  For  example,  Dreyfus  and  Dreyfus 
(1936)  describe  numerous  examples  of  expert  systems  that  did  not 
successfully  meet  their  intended  goals.  I  believe  the  current 
process  of  acquiring  domain  information  ignores  some  basic  design 
pririciples  that  human  factors  engineers  use  daily. 

Central  to  this  concept  is  an  appreciation  for  the  information 
requiresaents  of  the  expert  when  performing  in  the  domain.  Addis 
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(1985)  has  indicated  that  a  more  complete  understanding  {rooted  in 
theory  and  establishment  of  in-depth  techniques)  of  the  human  factor 
in  the  process  of  expert  system  design  is  required  if  the  science  is 
to  move  forward. 

Kidd  and  Sharpe  (1988)  are  also  concerned  with  the  lack  of 
research  investigating  human  expertise  in  artificial  intelligence- 
related  fields.  They  regard  the  current  generation  of  expert  systems 
as  experiments,  which  have  focused  impressive  amounts  of 
computational  power  on  specific  problems  in  highly  isolated  domains, 
but  have  yet  to  achieve  sufficient  basis  in  theory  to  allow  growth 
into  diverging  domains.  They  write: 

Success  of  the  system  is  directly  determined  by  the  appropriate 
representation  and  application  of  specific  knowledge  from  that 
domain  to  solve  an  isolated  problem.  Despite  the  vast  amount  of 
data  now  available  as  a  result  of  these  experiments,  we  are 
still  unable  to  explain  the  "why"  or  **how"  of  successful  systems 
or  to  predict  for  which  other  domains  and  tasks  the  current 
techniques  will  work.  This  is  because  no  theory  of  tasks  or 
domains  currently  exists  {p.  147). 

These  represent  a  sample  of  the  comments  researchers  have  made 
urging  additional  research  and  improvement  of  the  expert  systems 
development  process. 


The  Nature  of  the  Problem 

Allen  (1987)  describes  five  examples  of  traditional 
methodologies  of  building  expert  systems.  Each  of  the  methods 
require  a  step  to  gather  and  define  relevant  domain  knowledge  that 
contributres  to  performance.  This  identification  and  structuring  of 
the  domain  knowledge  necessary  for  adequate  performance  is  gathered 
using  otfen  painstaking  and  inefficient  interviews,  known  as 
knowledge  acquisition  (Boose  and  Gaines,  1988).  The  entire  success 
or  failure  of  an  expert  system  is  usually  determined  in  the  knowledge 
acquisition  phase.  Improvement  of  this  step  would  make  a  significant 
improvement  to  the  expert  system  development  process. 

Expert  Systems  Knowledge  Acquisition 

The  knowledge  acquisition  process  is  typically  performed  by  a 
knowledge  engineer  (or  engineers)  who  interviews  and  questions  the 
domain  expert  (or  experts)  using  real  and  hypothetical  examples  of 
cases  to  determine  the  heuristics  used  by  the  experts.  When  these 
"rules  of  thumb"  are  stated  in  an  "if-then"  format,  a  rule-based 
model  of  domain  expertise  is  created  (Klahr  and  Waterman,  1986). 

This  set  of  rules  forms  the  basis  tor  the  rule-based  expert 
system.  If  this  set  of  rules  is  incomplete  or  in  error,  the  system 
will  not  perform  as  anticipated.  Revision  of  the  rule-set  and 
additional  expert  interviews  are  required  to  bring  the  system  up  to 
acceptable  levels  of  performance. 

This  problem  of  a  long  and  tedious  cycle  of  interviews  and  rule- 
set  revisions  has  been  referred  to  as  the  "knowledge  acquisition 
bottleneck"  (Fsigenbaum,  1977,  p.  71).  Waterman  (1986)  has  observed 
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step  c-sn  e.'stand  “over  a  period  of  many 
setJiods  of  knowledge  acquisition  that  allow  the  expert 
-r.  to  comunicate  directly  with  the  toachine  to  develop  rule-sets  have 
—  l3een.  developed  to  circumvent  this  problem  (see  Quinlan,  1987,  for 
.  vSpme  examples).  ■Jowever,  the  need  to  refine  and  correct  the 

Itaawl.edgfe  initially  gained  is  still  evident  in  spite  of  these  new 
methods  (Klahr  and  Waterman,  1985). 

Many  reasons  have  been  offered  to  account  for  the  diff iculties^ 
encountered  in  knowledge  acquisition.  For  example,  experts  are 
believed  to  have  difficulty  articulating  deeper-level  rules,  experts 
may  forget  to  include  rules  they  take  for  granted  ( commonsense) , 
and/or  experts  may  make  incomplete  or  erroneous  assumptions. 
Generally,  the  difficulties  focus  on  the  problems  inherent  in  the 
interview  process  and  getting  domain  experts  to  translate  largely 
intuitive  processes  into  verbal  representations. 


Why  Is  There  a  "Bottleneck" 


Artificial  intelligence  and  expert  systems  researchers  have 
failed  to  notice  their  traditional  approach  used  in  building  rule- 
based  expert  systems  constrains  the  domain  analysis  to  only  those 
elements  supported  by  the  current  level  of  technology.  Herein  lies 
the  cause  of  the  "bottleneck”  problem.  This  bias  towards  the 
limitations  of  expert  systems  technology  can  prevent  system  designers 
from  adequately  understanding  the  domain  and  those  infortaation 
elements  critical  to  successful  performance  in  that  domain.  Figure  1 
depicts  the  steps  involved  in  this  traditional  approach. 


KJk*  OnawnttinM 


! 

( 

rueit  i.  TndkieMl  «»  INMee  Ij—i. 

In  Step  1,  the  Expert  Systems  Capabilities  Space  (ESCS)  is 
developed  in  the  min'd  of  the  knowledge  enginesir  ('KE)  through 
experience.  This  represents  what  the  KE  believes  expert  systems  can 
do  and  the  types  of  information  they  can  support.  The  content  of  th« 
ESCS  is  limited  by  the  knowledge  engineer's  contact  and  understandinc 
of  expert  systems. 

As  she  performs  the  knowledge  acquisition  process  in  Step  2,  an 
Elicited  Domain  Information  Requirements  Space  (EIRS)  is  developed 
basid  on  rules  elicited  from  the  True  Domain  Information  Requirement: 
Space  (TIRS)  via  the  domain  expert"!!  The^ErRS  is  only  as  complete  as 
what  the  domain  expert  states  and  is  included  as  important  by  the  KE 
It  is  necessarily  an  inocmplete  subset  of  the  TIRS. 
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fisure  2.  IhiMipU* Bated  Apcnuci  »  Buldiat  Exsen  Eyxteim. 

In  step  3r  the  ESCS  are  mapped  onto  the  SIRS/  apparently 
covering  the  entire  domain.  However,  in  Step  4,  after  actual  use, 
system  performance  is  often  found  to  be  less  than  expected.  If  it 
were  possible  to  map  the  ESCS  onto  the  TIRS,  a  significant  portion  of 
the  domain  would  be  found  to  be  unsupported.  This  lack  of  support 
erplains  much  of  the  resulting  poor  system  performance. 

Conclusion  and  Recommendations 

The  knowledge  engineer's  inherent  bias  towards  the  system 
prevents  him  from  fully  understanding  and  appreciating  the  domain 
information  requirements.  The  KE's  attention  to  what  the  system  can 
support  often  distracts  her  from  identifying  what  information  is 
necessary  and  critical  to  domain  performance.  Therefore,  the  most 
relevant  (but  often  unsupported)  information  aspects  of  a  domain  are 
not  included  in  the  expert  system  rule-set,  resulting  in  sub-standard 
system  performance. 

An  appropriate  model  of  human  cognitive  task  execution  (see 
Horn,  Koubek,  and  Cacioppo,  1989)  applied  to  the  knowledge 
acquisition  process  would  result  in  a  more  complete  and  valid 
representation  of  the  domain.  Figure  2  outlines  the  use  of  such  a 
model  in  the  development  process.  Steps  1  and  2  use  theory  to 
specify  and  define  both  the  domain  elements  and  capabilities  of 
expert  systems.  What  is  important  to  note  is  that  the  domain 
information  requirements  are  defined  first,  to  insure  the  all 
relevant  and  critcai  aspects  of  the  domain  are  represented.  Step  2 
then  casts  the  capabilities  of  the  expert  system  inlight  of  those 
domain-specific  information  requirements.  Therefore,  in  Step  3, 
mapping  the  two  together  results  in  an  accurate  estimate  of  the 
degree  of  support  (coverage)  that  can  be  expected  by  the  expert 
system. 

In  conclusion,  by  utilizing  the  human  factors  principles  of 
user-centered  design  and  identification  of  domain  information 
requirements,  it  is  appears  possible  to  mitigate  tlie  problem  of 
system-bias  in  the  knowledge  acquisition  process.  Research  to 
investigate  this  hypothesis  is  recommended  to  improve  the  critical 
function  of  knowledge  acquisition  and  result  in  more  capable  expert 
systems . 
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A  Oonparisan  Between  ileural  lletuciEk  eund  Buie  Based 

}Ss)aa£fer  SeiXections  in  an  Air  Occfcat  Training  Systen 
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Abstract 

The  purxose  of  the  present  research  was  the  ooppariscn  of  a  rule 
baaed  esgp^rt  system  against  a  neural  network  ea^sert  system  in  the 
domain  of  air  coobat  naneinrering.  Diffezenoes  between  the 
aixhitacturBS  were  eoqpilceed  and  hypotheses  as  to  causes  of 
differential  perfozsEnoe  were  made.  In  addition,  a  methcdalogy  for 
canwerting  rule  baaed  systems  into  a  neural  network  was  also 
preaantedL  Beth  Tncdels  were  ooepared  with  ssqpert  fi^xter  pilots  on  a 
transfer  task.  The  neural  network  agreed  with  maneuver  selections 
made  by  eaqpert  fie^iter  pilots  2.5  times  more  often  than  the  rule 
baaed  system.  !!hese  findings  were  eatplainpd  in  terms  of  tdie  ability 
of  neural  nets  to  generalize  maneuver  selacticns  to  novel  edrspaoe 
oenditions.  Other  iaplications  of  these  results  were  also  discussed. 


The  goal  of  this  research  is  to  det,>elop  a  neural  network  model  that 
selects  offensive  snd  defensive  soaneuvers  for  the  domain  of  air  oenbat 
maneuvering,  ^pacifically,  the  present  research  will  oempare  a  rule  based 
azchitectuce,  Air  Conbat  Bigert  siaulation  (ACES) ,  aigainst  a  neural  network 
architecture,  Tactical  Air  Oasobat  Intelligent  Trainer  (TACIT) ,  as  models  of 
Air  Ocnfaat  Maneuv^ering  (ACM) .  Bach  model  is  designed  to  select  basic  f i^xtsr 
maneuvers  (i.e.,  manEuvers  that  enhance  one's  tactical  position)  during  ACK. 
The  ultimate  goid  of  the  presait  work  will  be  the  impleoentation  of  a  stand 
alone  ptgsonal  oesputer  training  systan  to  be  xrsed  as  an  adjunct  to  flight  and 
classrocm  instruction  during  the  training  of  undergraduate  fighter  pilots. 

Qxrrent  work  cn  TACTT  is  a  direct  desoendent  of  previous  work  dene  by 
Goldsmith  and  schvaneveldt  cn  ACES  (Goldaoitii  &  Schvaneveldt,  1987) ,  ACES 
selected  classical  maneuvers  using  a  series  of  production  rules  defined  as 
ocndltionracticn  or  if-^then  statements.  An  eacaaple  mic^t  be,  if  my  eppenent 
is  in  front  of  me  and  our  range  is  less  than  1500  feet  Ihen  fixe  guns.  In 
all,  there  are  38  production  rules  that  select  12  offensive  and  5  defensive 
cl  apical  maneuvers.  Curing  operation,  ACBS  sanples  2m  ACM  soenario  and 
attespts  to  find  matches  between  rules  emd  ACM  oonditiens.  Vhen  a  match  is 
found  a  rule  is  selected.  Becaxise  ACM  is  such  a  dynamic  decision  caking 
envircement  it  is  quite  often  the  case  that  oonditiens  for  more  than  one  rule 
are  satisfied.  When  more  than  oie  rule  has  been  selected  a  tie-breaking  or 
cxnflict  resolxzticn  procedure  is  applied  in  an  attempt  to  discriminate  the 
best  maneuver.  ACES'  conflict  resolution  scheae  is  to  select  the  most  ga^eral 
rule.  That  is,  the  maneuver  rule  that  has  the  fewest  edrspaoe  descriptors 
defined  (i.e.,  fewest  nunber  of  canal tiore  uefJjuu)  Is  btHuCueu. 

.A  problem  that  many  conflict  resolution  schtanes  have  is  that  they  operate 
at  a  syntactic  level.  Another  way  of  stating  this  is  that  the  information 
oentained  within  the  condition  half  of  tied  rules,  that  was  initially  used  to 
mate  selections,  is  not  used  in  the  conflict  resolution  process.  Rather, 


lagttt^jjRfeaaatioR  such  as  how  xoany  or  hew  few  oonditienB  are  qweifAed  hy  the 
4^  of  rules  beontBSK  the  basis  of  dlsariminating  between  potential  actions. 

Xt  -mi  be  the  case  that  sds-qxxjopB  of  edrspaoe  oenditions  within  rules  cany 
iapgctant  ddacxajBin&tocy  infanaaticn  beyond  that  found  in  laeasures  of  the 

or  epacdi^lclty  of  the  individual  rules.  ISaan^  ocnflict  resolution 
jpe»r»dur«»  ignore  this  aenantic  aepect  of  a  rule.  One  approach  to  capturing 
epi^fic  oonfiguxatiens  of  oenditi^  in  zdiepace  scenarios  is  to  %<rite  large 
saribers  of  unigue  rules.  Chfortuaately,  in  dyneodc  envdxanoients  such  as  ACM 
this  can  lead  to  vast  ct where  of  rules.  In  an  attaept  to  overooee  this 
littitaticn  of  rule  based  eagtert  systems  a  neural  network  model  of  ACM  was 

A  aajeo:  advantage  neural  network  aodpJs  have  over  rule  based  sysbess  is 
that  th^  are  designed  so  ttiat  performance  degrades  gracefully  given 
inncgplete  or  noi^  ^ocif icatlro  of  input  infaraaticn.  Neural  networks  are 
designad  such  that  they  aelaot  an  action  in  tens  of  previously  learned 
mappings  at  stimuli  to  responses.  Ihe  neural  network  used  here  is  able  to 
generalize  to  previously  learned  responses  given  incoeplete  or  novel  instances 
at  airapaoe  oenditions.  In  other  words,  to  the  extent  that  a  new  set  of 
cofiditijTO  describing  an  ACM  scenario  is  similar  to  a  pattern  that  has  already 
been  trained  into  the  network,  a  similar  pattern  of  processing  will  oosur 
across  the  network  resulting  in  a  similar  reqonse  (Arbib,  1987) . 

AJMther  advantage  neural  networks  have  ever  rules  is  that  the  network  is 
trained  in  lauch  the  same  wey  undergraduate  Pilots  (UPs)  euce;  >~naaely,  both 
UPS  and  Ihe  nebdork  are  eagxmted  to  a  large  xusber  of  ACM  scenarios  and  a^ced 
to  make  the  igproprlate  maneuver  selections,  ipon  selection  of  maneuvers  both 
UPs  and  the  network  axe  given  response  f eecfiaack  until  they  learn  to  make 
appropriate  maneuver  selections. 

Since  the  maneuver  rules  in  AC£S  where  based  on  intervieus  with  expert 
pilots  as  %iell  as  validated  against  eaqperts  it  was  thought  that  there  was  an 
isportant  knowledge  base  contained  within  those  xxrles.  Therefore,  the 
dg^sicn  was  rads  to  train  a  neural  network  using  the  inf ersstien  oca±ainad 
within  tiie  production  rules.  In  order  to  train  a  network  using  this 
infexanation  it  was  necessary  to  rsHocnceptualize  rule  based  maneuver  selection 
as  a  classification  task.  The  condition  half  of  a  rule  was  viewed  as  the 
prototype  or  central  tendency  for  making  a  loaneuver  classification.  That  is, 
the  conditions  were  viewed  as  tiie  attributes  that  oenpoRed  the  pi'ctotype  while 
the  actions  were  thought  of  as  the  categories  into  which  each  prototype  was 
classified.  Table  1  illustrates  the  transformation  of  an  aooaleratim 
maneuver  (AC)  into  a  prototype  with  its  associated  maneuver  category. 


RenAsTtion  mie  Network  Training  lattem 

select  (AC)  if  prototype: 

ny_aircxaft{0/45,_,B,_) , 

opponent  2drcxaft(_,_,F, 5/7) ,  [22.5,_,0,_,  ,  ,l,6,7,_,-75] 

relativeT2/l2,_, -400/250) . 

xansuver  class: 

(l,0|0,0,0,0,0,0,0,0,0,0,0,0,0,0,0j 


Table  1.  A  Produrtion  Kula  Oaroepfcualized  as  a  Prototype 
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ijIt'Bbqjild  3ae  aotad  tfaat  underlined  blank  spaces  in  both  the  pareductian 
::^0  4nd  the  inotot^fpe  ccgrecpapd  to  conditions  that  are  un&pecified.  In 
;dt(M  vhetc  the^  «bs  a  xangre  of  possible  values  for  a  specljric  aicapeoa 
condition  tbe  average  value  v^B&  used  in  the  netsock  training  pattezst.  ihe 
S^UMlUvor  categories  sjjply  T*ryw******^  as  a  binary  vector  ^here  each  value 
cor%’e[^)onds  to  a  aanaiver.  In  this  eosncple  aooeleraticn  is  the  first  value  in 
the  vector  and  is  repcesentad  as  1  %hile  all  other  aaneuvers  are  represented 
by  06.  *B)e  38  rules  in  ACXS  were  raocntiguxed  as  38  pocotot^pes  and  associated 
catagooEy  xmtae,  The  38  pcototypeKategory  vectors  were  used  as  the  input- 
OUQ^  pabbsms  on  Which  the  neural  netMork  %as  trained. 

In  a  previous  stmly  Qcaldsadth  and  Schvaneveldt  (1987)  presented  a  series 
of  40  ain^aoe  soeoaricss  to  eaqpert  fighter  pilots  %hD  were  asked  to  select 
oeineucvers.  The  nlrspnoe  aoanarioe  presented  to  the  expert  pilots  and  the 
aemeuver  selections  tiiey  oade  will  be  used  to  validate  the  prodtction  rules 
and  the  neural  network  laaneuver  selection  architecture.  The  data  ooiUected 
fEcn  ea^art  pilots  will  also  be  used  to  cecpare  tiae  perfomanoe  of  both 
aodels. 


Method 

network  Taalcav 

The  specific  network  to  be  used  was  a  nulti-layerol  peiceptrcn  uodel  tdth 
a  nonlineea:  activation  function.  The  model  was  tzainad  using  the  standard 
delta-rule  or  berk-propagation  gradient  descent  learning  algcadthm  (Bao, 

1939) .  The  network  had  three  layers  drive)  by  twelve  input  ocnditions.  The 
first  hidden  layer  had  12  nodesi  the  seocxid  hidden  had  20  nodes,  2und  the 

layer  bad  17  ncadae  (a  12-17-20  network) .  all  nodes  were  oaopletely 
acmacted  to  suaoessive  Ixyea:  nodes  resulting  in  a  total  of  688 
interaartnections.  Each  oonnecticn  is  operatiovQlzed  as  a  weight  which 
reflects  tiie  degree  of  association  between  eekch  node  and  every  other 
sucxaessive  layer  node. 

The  network  was  trc.^^)od  by  presenting  each  of  the  saneuver  prototypes, 
applying  the  non-linear  activaticx)  function,  ccnputing  an  error  teza,  and 
nodifying  the  nebiAiak  interoGmecticns.  It  took  17,500  blocks  of  nanauver 
presentations  (i.e.,  1  block  is  a  single  presentaticn  of  the  entire  set  of  38 
maneuver  prototypes)  for  the  network  to  lefrn  to  correctly  classic  36  of  38 
maneuvers.  The  reason  the  network  did  not  xeam  all  38  maneuver 
classifications  was  that  there  was  an  insufficient  nunher  of  connection 
weight  (i.e. ,  the  netwesk  was  too  small) . 

Results 

The  rule  based  system  agreed  with  expert  pilot  maneuver-  selectrons  in  10 
of  40  transfer  scenarios  (25%) .  The  neural  network  maneuver  selecticarB  agreed 
with  expert  pilot  selections  in  27  of  40  transfer  soenarioe  (67%) .  Using  a 
binonial  distribution,  the  probability  of  either  model  agreeing  with  e)g>ert 
pilot  maneuver  selecticns  at  the  levels  reported  here  die  to  chance  is 
essentially  zero  (p  <  .0001) .  )4iile  both  iirdels  perfonijed  well,  it  should  ce 
noted  that  the  neural  network  agreed  with  pilot  icaneaver  selection  rjsrar  2.5 
times  better  than  the  producticn  system. 


niscussicgi 


Hhile  bcvth  agraad  vita  the  xaaneuver  selections  made  by  eiqpext 

pilots  at  levels  significantly  better  than  dbancB,  the  perforaanoe  of  the 
neural  network  vas  nudi  better  than  the  rule  based  ^^sten.  Initially,  this 
firming  puzzling  in  that  the  neuzal  network  vas  trained  to  zocxsgnlze 

the  oaiditioMi  fron  the  production  ^stem  as  aaneover  categorijes.  In  other 
words,  the  neural  network  contained  the  same  infonoaticn  as  is  found  in  the 
production  system,  fibe  reason  for  the  differenoe  lies  vitli  the  ability  of 
neural  networks  to  gzacefuUy  degrade  given  inocxoplete  or  nci^  ii^ut.  Keural 
netwoados  do  not  have  the  arrhitectxgal  constraint  of  Ivsving  to  xeake  ea^icit 
erudition  TBetrhea  nor  do  they  have  to  apply  ccnflict  resolution  fesr  a  saneuver 
to  be  made.  Rather,  saneuver  selection  is  driven  by  the  degree 
of  similarity  between  the  pattern  of  activation  In  the  network  and  the 
patterns  initially  into  the  netwoadc.  A  useful  metaphor  is  to  think  of 

each  tnuisfer  emotion  as  having  a  distance  between  itself  and  the  38 
prototype  patterns  initially  trained  into  the  network.  The  shorter  the 
distance,  the  greater  the  probability  that  the  transfer  pattern  will  be  placed 
into  that  category. 

Ihe  production  system,  on  the  other  hand,  yieldled  tied  productiors  on  the 
majority  of  transfer  scenarios*  Ihe  result  %eis  that  'tiie  ccnflict  resolution 
strategy  euhltxated  final  maneuver  selection  on  most  transfer  trials,  ihis 
vaa  sepported  by  the  fact  that  %hen  fi^iter  pilot  maneuver  selection  was 
caenpared  with  the  set  of  edl  tied  productiens,  agreanant  was  nearly  95%.  It 
appears  that  the  ccnflict  resolution  strategy  esployed  by  fiCES  degraded  the 
agreement  %d.th  first  maneuver  selection  by  e3<pert  pilots. 

It  is  the  case,  however,  that  both  fi^rter  pdlcts  and  tutoring  systens 
act  \jpcn  first  anneuver  selection.  This  zoakes  the  first  selection  per 
soanarlo  the  critical  perfanoanoe  test  for  a  tutaririg/eagiert  system.  In  this 
regard,  the  neural  network  luplenented  in  the  TACIT  s^’stem  performed  at  a 
superior  level  to  the  production  system.  VSiile  it  may  be  the  case  that  an 
increased  nmber  of  productions  sensitive  to  unique  airspace  conditions  and/or 
inclusion  of  semantically  based  conflict  resoluticn  strategies  xaay  enhance  a 
rule  based  model's  ability  to  generalize  to  novel  ACM  soenarioe,  neural 
networks  alreei^  have  this  ability  as  a  basic  oespenent  of  their  architocture. 

In  oonclusion,  a  method  has  been  dmoenstratad  whereby  rules  firm  a 
production  systan  can  be  used  to  train  a  neiiral  network.  The  main  baief its 
are  reflected  in  enhanued  perforaanoe  eis  a  result  of  the  model's  ability  to 
generalize  to  new  instances  of  airspace  conditions. 
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SstaJjClisliing  Instructional  Strategics 
for  Advanced  Interactive  Technologies 


Demiel  J.  Kuraida 
Jonathan  K.  Spector 
Air  Force  Human  Besources  Laboratory 
Brian  E.  Dallman 
3400  Tcarw,  Lovry  AFB 


Abstract 

Instructional  Systems  Design  (ISD)  in  the 
military  is  based  on  a  behavioral  suodel  of  learning 
and  a  systems  approach  to  engineering  mamageaent. 

The  current  ISO  process  is  adequate  for  some 
traditional  educational  setting.  Hovever,  advances 
in  cognitive  science,  nev  interactive  training 
tedtuMlogies,  and  increasingly  complex  training 
requirements  indicate  a  need  to  broaden  the  learning 
theory  that  drives  XSD  ax^  to  adopt  a  more 
integrated  approach  to  training  development.  The 
Advanced  Instructional  Design  Advisor  (AIDA)  is  a 
proposed  method  to  test  and  Integrate  nev 
instructional  strategies  for  teaching  complex  tasks 
using  advanced  technologies. 


Instructional  Systems  Design  (ISD)  is  the  est^a>li8hed 
process  for  designing  and  developing  instructional  materials 
for  military  training.  This  process  works  well  enough  for 
relatively  simple  materials  to  be  presented  in  a  classroom 
setting  (Montague,  1988) .  However,  the  ISD  process  is 
bankrupt,  if  not  broken,  when  it  cx>ses  to  providing  specific 
(Tuidelines  for  teaching  complex  tasks  in  an  interactive  setting 
(Muraida  t  Spector,  1989) . 

Advances  in  educational  technologies  have  brought  the 
limitations  of  ISD  to  light.  Given  a  variety  of  availeible  and 
affordable  presention  media,  how  should  materials  be  selected 
and  presentwi  so  eis  to  maximize  understandixig,  retention,  amd 
tr2tn8fer?  The  response  to  this  question  has  been  to  give  the 
task  to  highly  qualified  and  creative  individuals  and  see  what 
they  produce  (Montague,  Wulfeck,  &  Ellis,  1983).  The  answer 
has  been  that  imagination  is  the  limit  to  instructional  design. 
What  is  lacking  is  a  systematic  method  to  determine  whose 
imagination  is  effective,  when,  and  \^y. 


**«»^**  a.  jr 


that  there  is  not  a  theoretically  based  justification  for  using 
anything  other  than  chalk  emd  an  instructor's  imagination.  What 


IS'iacldLng  is  a  well  developed  instirucrtional  theory. 

There  is  obviously  a  great  deal  that  ?  e  do  not  know  about 
how  people  learn,  so  the  best  that  instructional  theorists  can 
hope  to  get  from  leading  thaoiry  is  a  goi-d  direction  to  pursue. 
The  key,  then,  to  developing  am  instructional  theory  will  be 
the  testing,  refining,  and  refuting  of  those  instructional 
prescriptions  suggested  by  leztming  theories.  The  Air  Force 
^laian  Resources  LzQ>oratory'6  Advanced  Instructional  Design 
Advisor  (AIDA)  is  intended  to  provide  the  key  instructional 
design  validation  component  necessary  to  developing  em 
instructional  theory. 


Problem 

It  is  difficult  to  claim  that  the  instructional  design 
techniques  used  by  Air  Force  personnel  are  inappropriate  or 
fail  to  work.  There  is  sufficient  evidence  to  indicate  that 
motivated  subject  matter  experts  (SHEs)  can  vise  the  existing 
instructional  design  model  to  produce  a  training  system  which 
meets  the  training  need  (Montague,  1989) .  Experienced  SHEs 
invarizibly  choose  a  robust  design  mediated  by  the  most  flexible 
medium  known:  classroom  lecture/ laboratory  and  instructor- 
beised.  The  problem  is  not  that  current  ISD  procedures  are 
inadequate  to  the  t2Lsk  of  producing  effective  classroom 
setti^,  instructor-based  technical  training. 

Part  of  the  problem  is  that  there  is  a  scarcity  of  knowledge 
and  experience  in  designing  instruction  to  be  delivered  using 
new  technologies.  Even  the  best  professionals  produce  wasteful 
or  inappropriate  designs. 

There  has  been  no  comprehensive  evaluation  of  the  relative 
cost-effectiveness  of  training  systems  produced  by  different 
categories  of  instruct ioneil  designers.  Recently,  an 
established  aerospace  firm  with  excellent  track  record 
produced  a  course  to  teach  Air  Force  technicians  maintenauice 
procedures  for  a  new  weapons  system.  The  students  complained 
that  the  $1M  training  program  left  them  confused  and  ill 
prep^u^ed  to  perform  job  tasks.  If  a  major  vendor  with  skill->:d 
professionals  can  make  such  obviously  poor  design  decisions  in 
using  advanced  training  technologies,  then  the  extent  of  the 
problem  within  the  Air  Force  training  community  could  be 
severe . 

This  problem  in  mzOcing  effective  use  of  new  technologies  is 
compounded  by  the  tendency  to  use  more  distributed  training. 
Delivering  instruction  at  the  job  site  has  the  obvious 
advantage  of  keeping  personnel  close  to  their  daily  duty 
functions.  The  disadvantage  is  that  the  job  sites  lack 

design  and  development  personnel. 


.  7  ibfi  cJioicas  are  -two:  i)  provide  the  needed  expertise  in  the 
JLieid  using  tools  and  expert  syeteas  to  aid  the  instructionaLl 
design  eind  developaaent  process,  or  2)  develop  effective 
training  to  be  delivered  independently  via  computer  at  the  job 
site.  Whichever  path  is  taken,  the  signpost  is  obvious: 
effective  use  of  new  trzLiixing  technclogies  is  the  key  to  the 
solxrt:ion. 

A  recent  survey  at  Lwry  Technical  Training  Center  revealed 
that  a  general  lack  of  knowledge  concerning  educational 
principles  and  their  implicatioiis  for  instructional,  design 
existed  at  2l11  levels  of  the  decision-making  hierarchy  (Muraida 
&  Spector,  1989) .  Personnel  readily  adxaitted  that  they  were 
not  comfortable  in  performing  many  of  the  design  and 
development  functions  necessary  to  develop  cpiality  instruction. 

This  problem  is  coa^ounded  by  the  need  to  use  these  new 
tecdmologies  to  train  increasingly  complex  weapons  systems. 

The  complexity  of  new  systems  has  two  implications:  1)  the 
resulting  training  requirements  will  be  highly  complicated,  and 
2)  the  requirement  to  train  effectively  increases  in  importance 
—  complex  new  systems  are  typically  placed  in  situations 
calling  for  the  highest  system  reliability.  Skill  acquisition 
and  skills  maintenance  become  extremely  important.  The  promise 
is  to  hzindle  the  complex  training  requirements  using  new 
technologies.  The  problem  is  to  deliver  instructiori  that  is 
highly  effective. 

The  amount  of  knowledge  necessary  to  design  instruction  in 
these  sitxiations  will  continue  to  increjise  rapidly.  A  current 
instructional  design  system  beised  on  expert  system  technology 
might  take  about  10,000  rules.  This  is  already  too  many  to 
expect  any  individual  to  master.  We  don’t  have  years  to  train 
instructional  designers.  The  problem  is  that  we  need 
instructional  design  expertise  with  advanced  technologies  now, 
and.  ve  need  to  maintain  that  knowledge  as  new  techniques  emd 
principles  are  established. 


Solution 

The  problems  just  discussed  indicate  a  growing  need  for 
instructional  design  expertise,  especially  for  training  of 
complex  tasks  to  bs  delivered  using  advanced  interactive 
technologies.  However,  these  technologies  are  new  and 
cognitive  science  is  embryonic.  As  a  consequence,  there  is  no 
sizeable  cadre  of  instructional  design  experts. 

The  shortage  of  human  experts  suggests  the  possibility  of 
capturing  the  best  humaji  instructional  design  knowledge  in  an 
expert  system.  Several  instructional  design  expert  systems  are 
under  construction,  the  most  well-)uiown  of  which  is  probably 
Merrill's  ID  EXPERT  (MerrilJ  &  Li,  1989).  These  systems  will 
most  likely  prove  useful  given  the  complexity  of  today’s 


’Hijr&ilsing  environment*  although  Richards  (198S)  argues  that 

designers  proceed  with  caution  in  using 

expert  systems,  The  development  of  automated  design  and 
development  tools  will  also  provide  a  key  component  in 
Addresjsing  the  problem  of  effectively  using  these  new 
technologies , 

Even  if  robust  instruct  ioned.  design  es^>ert  systems  acre 
implemented  successfully,  there  will  be  a  need  for  additional 
research  to  develop  an  integrated  instructional  theory. 
Encapsulating  current  knowledge  ahoMt  instructional  design  in 
an  expert  system  should  not  preclude  the  expansion  of  our 
3aiowiedge  about  instructional  design. 

A  well  developed  instructional  theory  should  be  informed  by 
established  learning  theories  and  should  consist  of  specific 
instructional  strategies,  principles,  emd  prescriptions  which 
cem  be  empirically  refined  and  refuted.  V?hat  is  needed  is  a 
systematic  way  to  test  instructional  tenets,  some  of  which  will 
pertain  to  the  optimal  use  of  advanced  interactive  technologies 
to  teach  complex  activities  involving  a  variety  of  knowledge 
types  and  skills.  The  test  vehicle  should  provide  a  means  to 
automate  as  much  of  the  development  and  delivery  of  the 
instructional  materials  as  possible  for  the  dual  purpose  of 
providing  rapid  development  of  designs  zmd  maintaining  test 
integrity.  The  Air  Force  Htunan  Resources  laboratory  is 
designing  AIDA  to  provide  the  necessary  experimental  platform. 

AIDA  is  based  on  the  following  assxuaptions:  l)  behaviorism 
is  not  adequate  in  providing  an  eiqjlanation  of  complex  learning 
activities,  2}  cognitive  science  suggests  that  instruction 
should  be  sensitive  to  the  limitations  of  short  term  memory, 
the  types,  representations,  and  org2mization  of  knowledge,  and 
the  situated  and  integrated  nature  of  human  activities,  and  3) 
the  principles  and  prescriptions  most  in  need  of  empirical  test 
and  refinement  are  those  which  pertain  to  the  selection, 
sequencing,  and  presentation  of  materials  for  specific  lesson 
components  in  a  highly  automated  and  individualized  learning 
environment.  In  short,  AIDA  is  a  means  for  keeping 
instructions  design  apace  with  advancing  educational 
technology. 

Ullmer  (1985)  has  identified  three  elements  of  an 
educational  technology;  1)  instrumentation,  2)  teaching 
regimen,  and  3)  image  of  the  learner.  With  regard  to  the 
learner,  AIDA  will  provide  a  means  to  determine  to  what  extent 
and  in  which  circumstances  learner  control  is  desirable.  With 
regard  to  instrumentation,  AIDA  will  provide  a  means  to 
determine  when  and  how  new  technologies,  such  as  digitized 
audio  and  video,  can  best  be  utilized. 
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teaching  regimen.  Weissman  (1988)  and  others  have  argued  that 


orte  OS  -eausationaj.  tecanoiogy's  aiain  rasks  is  ro  provide 
■students  wita^  a  leazmiag  environment  that  is  rich  in  both  tools 
add  data  so  that  leaoming  regiaisiis  can  be  tailored  to  specific 
needs • 


conclusion 

The  current  AIDA  research  plan  is  guided  by  these  three 
fitepa:  1}  establish  aui  initisd.  theoretical  foundation  based  on 
cognitive  and  behavioral  learning  theories,  2)  formulate 
strategies,  principles,  eind  prescriptions  consistent  with  that 
teeoretical  frzunework,  and  3)  test,  evaluate,  and  refine  these 
tenets  in  a  variety  of  instructioniLl  settings.  The  first  step 
will  be  complete  in  May,  1990.  The  second  step  is  expected  to 
be  complete  in  1991,  and  testing  is  expected  to  begin  in  1992. 

The  challenge  that  confronts  us  with  these  new  technologies 
is  to  understand  better  how  x>«ople  learn  and  to  foster  those 
learning  processes  using  new  technologies.  Without  a 
systfflsatic  methodology  for  testing  instructional  strategies, 
principles,  and  prescriptions,  progress  is  likely  to  be 
haphazard  and  wasteful,  especially  for  complex  tasks. 
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Factors  Atfecting  Career  Decisions  of 
K^norHies  in  Naval  Aviation 

Annette  G.  Baisden 
Naval  Aerospace  Medicai  institute 
LCDR  F.  Douglas  HohX)mbe 
Naval  Safety  Center 

This  poster  session  reports  the  devatapment  and  results  of  a  survey  questionnaire 
designed  to  identify  the  reasons  minority  aviators  decide  to  join,  remain  in,  and  leave 
naval  aviation.  About  one-third  cf  aii  first-tour  minority  aviation  officers  returned  the 
survey.  Results  suggest  that  some  reasons  are  important  for  attracting  and  retaining 
individuals,  but  that  different  reasor  may  accoi'nt  for  decisions  to  leave  the  Navy. 
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Gender  IHfferences  in  USAF 
Pilot  Trsining  Performance 

Thomas  R.  Carretia,  PhD. 

Air  Force  Human  Resources  Lab<Kator> 


The  Unites  States  Air  F«ce  GJSAF)  began  to  admit  won»n  to  Undergraduate  Pilot 
Training  (UPT)  in  September  1976.  By  September  1988,  422  of  637  (66.3%)  female 
pilot  caiuhdates  had  cocmleted  UPT  sticcessfiiUy  coiirpar^  to  77.7%  of  die  males  during 
toe  same  p^od  (USAF,  1988).  The  purpose  of  this  study  is  to  determine  whether  gender 
difference  in  Ui^  performance  can  te  explained  by  scores  tm  pre*seieciion  instrunicnts 
(c.g.,  apmude  test  sccjtcs,  academic  grades)  cunent^'  being  used  to  select  pilot  caadidaies. 
The  subjects  in  tihis  study  include  14,240  male  and  410  female  UPT  studeats  whe 
complc^  UPT  since  S^temba  1976.  Gender  effects  arc  being  examined  separately  for 
each  source  of  commission  (Air  Force  Academy,  Reserve  Officer  Training  Caps  and 
Officer  Training  School)  as  each  source  has  its  own  pilot  candidate  selection  procedures. 
The  prwlictor  set  includes  Air  Face  Officer  (^alifymg  Test  scores  and  gender  by  test  score 
interaction  terms. 

A  .series  of  regression  analyses  are  being  performed  to  detomine  whether  there  is 
evidence  of  diffcrcnti^  validity  (differences  in  regression  slopes,  intercepts  esr  dispersion) 
when  pretheting  UPT  performance  (e.g.,  graduation  vs  elimf.nation;  class  standing)  for 
mak  turd  female  candidates.  Implications  for  USAF  pilot  candidaie  selection  will  te 
discussed. 
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1989  Survey  of  Mr  Force  Life 


Louis  M.  Datko 

Air  Force  Military  Personnel  Center 


Abstract 


Every  three  years  since  1977,  the  USAF  Survey  Branch  has  used  an  omnibus 
"quality  of  life"  survey  to  query  members  Air  Force  wide.  The  Survey  of 
Air  Force  Life  (SAFL)  is  the  only  Air  Force  research  that  longitudinally 
examines  trends  of  Biesd>ers‘  perceptions  as  well  as  present  day  issues. 

Various  functional  agencies  participate  ir  the  survey  by  nominating  issues  of 
current  concern.  Included  in  the  1989  was  functional  representation  or. 
overseas  policies  and  programs,  housing,  Family  Support  Centers,  health 
resources,  public  affairs  and  human  relations.  Using  a  stratified  random 
sampling  technique,  the  SAFL,  administered  to  12,737  Air  Fores  meffllars, 
provides  senior  Air  Force  leadership  iiiformation  by  grade«g»‘Oiips,  gender, 
marital  status,  Total  Active  Federal  Military  Service  (TAFMS),  aeronautical 
rating,  major  command  and  career  Intent.  Trend  analysis  of  the  data  provides 
insight  into  retention  patterns,  carear  intent,  satisfaction  with  Air  Force 
life,  economic  well-being,  patriotism  and  work  relations.  Further,  a  detailed 
abroach  will  explore  possible  multivariate  relationships  between  satisfaction 
with  the  Air  Force  and  career  intent  for  the  officer  corps.  With  this  data 
added  to  that  obtained  in  previous  sur/eys,  the  Air  Force  will  have  documented 
over  a  decade  of  trends  on  Air  Force  members'  perspectives. 
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MMPl-2  UPDATE 


Dennis  Gaynor 
5605  Green  Circle  Drive 
Minnetonka,  MN  55343 
800-627-7271  ert.  5139 

The  Minnesota  Mutephasic  Personality  Inventory  (MMPI)  has  a  Song  history  of 
application  in  military  surroundings.  At  this  session,  there  will  be  a  disi^ssion  of  the 
restandardized  version  of  the  Mk^i-2.  and  handouts  of  the  new  scoring  reports.  The 
original  form  of  the  MMPi  was  used  for  over  50  years  with  no  revision  in  item  wording 
or  content. 

V7ith  the  M.MPl-2,  the  traditional  features  of  the  original  test  format  remain  unchanged; 
‘the  basic  scale  set 

-separate  profile  forms  far  male  and  female  subjects 

-handscoring  keys 

-norms  with  or  without  K  corrections 

The  revised  MMPi-2  features  are: 

-reused  test  booklet 
•restandaidized  national  norms 
-uniform  T  scores 
-new  content  scales 

Also,  there  wll  be  an  Obscan  5  scanner  on  display.  This  is  the  iatest  in  our  line  of 
scanners. 


Predicting  Expert  Individual  Decision  Making  Effectiveness 

William  H.  Hetvdrix 
Ctemson  University 

Recently  there  has  been  a  great  deal  of  iruerest  in  developing  e}q}ert  system  models. 
Usually  an  expert  system  is  based  on  a  single  expert,  however,  policy  capturing 
research  ^jggest  that  experts  frequently  cSffer  in  their  models  given  the  same 
informa&)n  or  cues.  This  research  investigs^  within  the  Brunswick  Lens  model 
whether  expert  effectiveness  could  be  predicted  from  a  rather  simple  poUcy  capturing 
project  Results  iruiicated  that  performance  on  a  policy  capturirtg  project  was 
predictive  of  pertonmance  on  two  expert  system  type  projects.  The  results  suggest 
that  more  effective  expert  system  models  can  be  developed  by  selecting  experts 
based  on  their  performance  cn  policy  capturing  proje^s. 


Data  for  laproveaent  of  Unitsd  States  Academies 

ClarA  L.  Hoamer 
39  Longtfood  Drive 
Sbaliaer,  PL  32579 
(904)  651-1739 

This  is  to  report  a  project,  ’•The  Clark  and  lorn  Hosmer  Educational 
Mesorial  Trust,"  for  an  annual  competition  among  the  five  United  States 
Academies  of  the  Air  Pores,  Army,  Coast  Guard,  Merchant  Marine,  and  Havy. 

Our  purpose  is  to  provide  data  on  the  elements  of  schooling  that 
contribute  to  graduates'  effectiveness  on  job  and  in  the  community.  The 
purposes  of  iixe  academies  and  their  Associations  of  Graduates  (AOG)  include 
production  of  effective  graduates,  large  class  memberships  in  the  AOG,  and 
collection  of  contributions  for  the  Academies'  betterment.  Our  project  vill 
help  to  fulfill  the  academies'  and  our  purposes,  at  minimum  cost. 

Part  of  the  low  cost  of  the  plan  derives  from  concentration  on  a  small 
portion  of  the  elamente  of  schooling.  The  data  to  be  collected  are  only 
the  elements,  if  enlarged  or  improved,  that  would  pay  off  most  in  graduates' 
effectiveneas.  Those  are  the  elements  at  the  top  and  the  bottom  of  a 

theoretical  list  of  all  the  elements  ranked  in  order  of  contribution 

to  graduatea'  effectiveness*  The  Services  use  the  came  principle  in  evaluating 
the  graduates  d\iring  their  careers.  Those  at  the  top  are  'enlarged'  by 
promotion;  those  at  the  bottom,  unless  improved,  are  not  and  may  be  separated. 

The  Trust  calls  for  the  AOG's  in  their  alumni  publications  to  request 
eacAi  graduate  in  the  claeses  5»  10,  and  20  years  out  to  name  only  the  two 

elements  of  schooling  that  contributed  most  and  least  to  his  or  her 

effectiveness  on  the  job  and  in  the  coEuiunlty.  After  several  years' 
experience,  the  AOG’s  request  could  list  the  major  categories  that  had  been 
most  frequently  cited,  plus  (ui  'other'  alternative.  At  the  present  time,  ve 
can  only  guess  what  data  might  be.  The  actual  data  will  be  the  payoff 
as  one  of  the  bases  for  strategic  reviev  of  the  conduct  of  the  performance 
of  the  mission  of  the  Academy. 

The  Academy  with  the  highest  number  of  usable  returns  before 
President's  Day  from  the  members  of  the  designated  classes,  divided  the 
three  classes'  total  gp^duates  minus  known  deceased,  will  win  tiie  annual 
competition.  That  Academy  will  have  its  name  inscribed  on  and  retain  custody 
of  the  Trust's  100  year  trophy,  until  a  different  Academy  wins. 

The  class  of  the  winning  Academy  that  contributes  the  highest  percentage 
to  the  total  percentage,  will  win  for  its  Class  Pund  at  least  $1,000. 

The  Trustees  will  insure  that  the  caah  awards  will  continue  to  have  at 
least  the  sans  value  by  retaining  from  income  and  adding  to  the  Truf  t 
principal  each  year  the  rate  of  Inflation  times  the  principal. 


Tout  criticisms  are  welcome.  Thank  you. 


The  Theory  of  Survival  Psycholc^ 

Captain  Robert  I.  Lawconneil,  PhD 
Frank  J.  Seiler  Research  Laboratory 
USAF  Academy  CO  80840-6528 


Abstract 

A  utility  function  which  may  be  useful  in  predicting  human  bdiavior  and  dedsions  is 
derived.  It  is  based  on  the  premise  that  the  primary  purpose  of  an  individual /family /group 
is  survival.  Survival  is  assumed  to  dq>end  on  obtaining  at  least  the  minimtiTn  r^uired 
amount  of  needed  resources.  It  is  also  presumed  that  obtaining  more  than  the  mininnun 
becomes  less  and  less  important  in  accordance  with  the  excess.  The  derived  utility 
function  is  then  used  to  msdce  theoretical  predictions  for  a  variety  of  repetitive  and 
non-wprtitive  chmce  scenarios.  The  theoretic  results  are  compared  to  the  correspondir.g 
e3q>CTimentaI  data  and  are  seen  to  be  in  gpod  agreement.  It  is  also  interesting  to  note  that 
many  aspects  of  risk  aversios  and  risk  tamg  follow  naturally  from  the  utility  function. 


i:TTecw5  07  :>p«rio  »  jxcnng 

Search  and  Target  Detection 


Major  George  R.  Mastroiannl,  Ph.D.  and 
Harry  Zwick,  Ph.D.,  Letterman  Army  Institute  of  Research 

Cadet  Bryan  Campbell,  United  States  Military  Academy 


Abstract 

It  has  been  shown  that  exposure  to  low-level  laser  radia¬ 
tion,  such  as  that  from  rangefinders  or  target  designators, 
can  cause  temporary  alterations  in  spatial  sensitivity.  The 
aim  of  this  research  program  is  to  q^uantify  the  effect  of 
spatial  filtering  on  the  detection  of  military  vehicles  in 
photographic  images.  Predictions  of  the  magnitude  of  expect¬ 
ed  gunner  performance  decrements  resulting  from  these  stud¬ 
ies  will  contribute  to  efforts  to  model  the  effects  of 
directed  energy  warfare.  Basic  research  efforts  conducted 
as  part  of  this  program  are  intended  to  characterize  the 
role  of  spatial  vision  in  visual  search  and  target  detec¬ 
tion,  and  will  provide  essential  theoretical  support  for 
such  probl«ns  as  the  design  of  effective  camouflage  and  the 
potential  integration  of  near  real-time  image  processing 
into  visual  sensors. 

Photographs  of  armored  vehicles  in  fighting  positions  In 
West  Germany  are  used  as  stimuli.  These  images  are  subject¬ 
ed  to  two-dimensional  fast-Fourier  transformation.  The 
Images  are  filtered  to  pass  only  high  frequencies,  only  low 
frequencies,  or  to  mimic  the  degradation  in  spatial  sensi¬ 
tivity  observed  in  monkeys  after  exposure  to  lasers.  These 
images  can  be  produced  either  in  color  or  in  black  and 
white;  overall  contrast  and  scene  luminance  can  be  closely 
specified.  The  stimuli  are  presented  using  a  computer 
projection  system  that  controls  the  timing  and  duration  of 
the  trials. 

Current  studies  use  a  simple  psychophysical  procedure  to 
determine  the  effect  of  filtering  on  detection  latency  and 
accuracy.  Performance  is  compared  across  all  tour  stimulus 
conditions  -  the  three  filtered  images  and  the  original, 
natural  scene.  We  are  in  the  process  of  integrating  a  SRI 
Generation  V  dual-Purkinje-image  eye  tracker  into  the  exper¬ 
iment  to  study  oculomotor  aspects  of  visual  search.  Behav¬ 
ioral  contingencies  will  eventually  be  overlaid  on  the  basic 
detection  paradipi  to  assess  more  realistic  cognitive  inter¬ 
actions  with  visual  search  of  degraded  scenes. 


Effect  of  e  Slnulated  Sustained  Flight  Operation  on 
C«>gfiitlve  Perforaaoce,  Grip  Strang  A,  and  Mood 


David  F.  Nerl,  LT,  MSC,  OSN 
Scott  A.  Sbcppell.  LT.  MSC,  USMR 
Charles  A.  DaJohn,  D.O. 

Naval  A'^raapace  Medical  Research  Laboratory 
Dermis  L.  Reaves.  LCDR,  MSC,  USK 
George  ttaahlngton  University 


Abstract 

Sustained  flight  operations  (SUSOPS)  tend  to  produce  both 
ttetital  and  physical  fatigue,  as  tiell  as  changes  in  stood.  This 
study  assessed  changes  in  auditory  and  visual  performance,  grip 
atrtfigth,  azud  aubjectlve  mood  during  a  simulated  SUSOF.  The 
scenario  consisted  of  s  9 -hour  planning  session  followed  by  4 
hours  rest  and  a  14-hour  nighttime  adsslon  (1900-0900).  After  6 
hours  sleep,  the  9-4-14  work-rest-work  pattern  was  repeated,  with 
a  daytlaa  mission  occurring  from  0400  to  1800.  Several  times 
during  the  planning  and  mission  segments,  12  subjects  performed  a 
battery  of  computer -administered  tasks,  inclxidlng  the  Dichotlc 
Listening  Test  (DLT)  and  a  sonar  detection  task.  Grip  strength 
was  meaaured  repeatedly  with  a  dynamometer  and  subjective  mood 
with  the  Addictios  Research  Center  Inventory  (ARCI).  According  to 
an  analysis  of  variance,  subjecta  showed  a  significant  incraase  in 
tha  number  of  errors  on  the  DLT,  a  slgnlficaim  drop  in  correct 
detections  on  the  soxvar  task,  and  a  aignif leant  reduction  in  grip 
strength  during  both  14-hour  missions.  The  ARCI  revealed  thet 
.subjects  felt  an  increase  in  fatigue  during  the  nighttime  mission, 
with  little  change  during  the  deytlme  mission.  They  also  reported 
a  decrease  in  intellectual  efficiency  during  the  ni^ttime  mission 
and  a  slight  Increase  during  the  daytime  one.  We  conclude  that  as 
few  as  two  consecutive  14-hour  adasions  can  result  in  a  decline  in 
performance  as  well  as  self-reported  fatigue.  Ho  performence 
decline  was  obtained  on  a  visual  search  or  tracking  task. 
Subsequent  analyses  will  coiq^are  these  date  to  a  scenario  phase - 
shifted  by  12  heurs,  to  further  examine  tise-of-day  effects. 


The  Effects  of  Uncertainty  of  Nap  and  Work  Duration  on 
Cognitive  Performance  and  Mood  State  During  Sustained  Operations 


Robert  E  Pleban,  PhD. 

U.S.  Army  Research  Institute 
for  the  Behavioral  and  Social  Sciences 
Fort  Benning,  Georgia 

Barbara  J.  Ross,  M.S. 
Department  of  Behavioral  Biology 
Walter  Reed  Army  Institute  of  Research 
Wahington,  D.C 


Abstract 

Research  was  performed  to  examine  the  cognitive  and  subjective  effects  of 
uncertainty  of  nap  and  work  duration  during  sustained  operations.  Eighteen  male 
subjects  were  assigned  to  one  of  three  conditions:  uncertain  nap,  certain  nap, 
and  no  nap.  The  uncertain  group  differed  from  the  other  groups  in  that  subjects 
were  not  given  any  ^cific  information  on  work-sleep  cycling.  With  the 
exception  eff  a  three  hour  nap  period,  the  work-sleep  schedules  were  identical  for 
each  group.  Performance  and  mood  were  assessed  over  three  sessions  (one  12 
hour  baseline  session  and  two  17  hour  work  sessions)  using  a  variety  of  computer 
based  tasks.  The  results  showed  that  uncertainty  of  work^leep  duration  had  both 
positive  and  negative  effects  on  cognitive  performance  depending  on  the  spedffc 
task  that  was  employed.  Reported  changes  in  mood  state  across  time  were 
generally  small  with  no  consistent  group  pattera  Overall,  the  ffoxlings  underscore 
the  value  of  naps  as  a  means  of  extending  performance  effectiveness  during 
sustained  operations.  Mwe  specifically,  these  results  indicated  that  for 
commanders  and  those  individuals  whose  mental  workload  is  extensive,  some  type 
of  sleep  discipline  must  be  practiced.  While  the  short  term  impact  of  napping 
may  be  negative  (L  c.,  sleep  inertia  effects),  the  long  term  performance  sustaining 
qualities  of  even  low  quality  sleep  can  be  significant  when  compared  to  m  sleep 
at  all 


PcedkdoG  ox  TrAiniag  Success  in  the 
Spedal  I^ces  Qualification  Course 


Rc^rt  J.  Pleban,  PhJD. 
Thomas  J.  Thompson,  PhJD. 
U.S.  Aniw  Research  Institute 
for  the  Behasdorai  azui  Social  Sciences 
Fort  Bemimg,  Georgia 


Abstract 

Recent  research  is  reported  which  examined  the  predictive  utility  of 
sdcctcd  measures  of  intelligence  (Wondcrlic  Personnel  Test  -  WPT),  personality 
(Jadcson  Personality  Inventory  •  JH),  and  biographical  information  in  predicting 
the  sucossshd  completion  of  ^  Special  Forces  Qualification  Course  (SFQC). 
Intelligence,  personality,  and  biographical  measures  were  obtained  from  293 
soldiers  attending  Phtae  I  of  the  SFQC  at  Fort  Bragg,  NC.  The  relationships 
between  two  of  &e  selected  predictor  measures,  WPT  and  JPI,  and  the  Phase  I 
performance  erheda  were  asUssed  through  a  correlationmultiple  regression 
strategy.  Predictive  utOi^  was  assessed  using  a  discriminant  a^ysis  procedure. 
Intelligence  (WPT)  correlated  significantly  with  overall  Phase  I  status.  Significant 
correlaticms  were  also  obtained  between  Phase  I  status  and  four  JPI  scales: 

Energy  Level,  Anxbty,  Risk  Taking,  and  Infrequency.  The  results  fiirther 
suggested  that  SF  can^dates  who  have  had  prior  spedalked  training  emphasizing 
land  navigadoa,  imq>  reading,  and  patrolling  (e.g..  Ranger,  Reconnaissance, 

Jungle  Warfare)  are  likely  to  be  much  better  prepared  to  complete  Phase  1 
successfully  than  those  candidates  who  have  not  such  training.  The  single 
best  predictor  of  Phase  I  status  was  inmlligence.  The  best  predictive  model  of 
Phase  I  status  consisted  of  three  variables:  the  WPT,  Energy  Level,  and  Risk 
Taking.  When  employed  with  the  present  sample,  this  model  was  able  to 
increase  the  total  percentage  of  correct  classifications  (successful-unsuccessful)  by 
113%.  It  was  concluded  that  the  use  of  a  valid  screening  program  could  offer  a 
significant  reduction  in  training  costs  by  insuring  that  the  selected  candidates  have 
the  basic  capabilities  and  temperament  for  mastering  the  content  of  the  course, 
thus  minimizing  attrition  and  the  number  of  candidates  recycled. 


Field  Observation  Methods  Training 
For  Military  Behavioural  Scientists 


Gerald  D.  Resch 

P.ILA,  PcKozial  Applied  Research  Associates 
Victoria  British  Columbia 

Summary  -  Poster  Session 


Within  the  Canadian  Forces  over  one  hundred  officers  &om  the  Personnel  Selection  Brandi 
am  employed  as  personnel  specialists  and  behavioural  science  advisors  to  bases  and  units. 
Increasingly,  their  responsibilities  include  the  conduct  of  field  research  in  die  Sea,  Land  and 
Air  environments,  as  well  as  the  provision  of  behavioural  science  advice  to  field  unit 
connnandKs.  In  an  effort  to  formalize  training  in  Field  Observation  Methods,  the  Director  of 
Pmonnel  Psychology  and  Sociology  (DPPS)  at  National  Defence  Headquarters,  Ottawa 
^tract»i  the  development  and  conduct  of  a  Field  Obsnration  Mediods  course.  The  course 
^was  conducted  during  a  Brigade  exercise  at  HohenfeOs,  Germany,  from  21  August  to  10 
September,  1989.  Each  of  the  14  participants  attended  a  one  week  theory  and  orientation 
session  in  Lahr,  Germany,  and  then  joined  separate  combat  and  combat  service  support  units 
for  two  weeks  in  the  field. 


The  course  material  brought  together  theoretical  and  practical  findings  from  the  fields  of 
Social  Psychology  and  Sociology.  All  material  was  adapted  for  application  to  the  military 
fidd  setting  based  upon  die  experience  of  the  Canadian  Service  Women  In  Non  Traditional 
Environments  And  Roles  (SWWTER)  Land  ‘frials  and  relevant  alHcd  military  studies. 


All  methods  of  field  observance,  from  complete  participation  to  complete  observation  were 
reviewed.  Eoqthasis,  however,  was  given  to  die  roles  of  participam-as-ebservo'  (PO)  and 
obsexver>8S-parucipant  (OP).  An  active  rather  than  passive  role  was  advocated  and  skill  in 
adopting  this  role  without  interfering  with  the  natural  setting  was  imparted. 


Human  relations  skills  as  well  as  the  survival  and  facilitative  skills  required  for  effective 
observation  in  combat  ann5  units  were  discussed.  Topics  included; 

•  strategies  for  reconnaissance,  contact,  negotiation  and  entry; 

•  issues  of  reliability  and  validity  of  field  observations; 

•  methods  of  recording,  calibratioD  cf  observers,  debriefing  and  inteipreudon; 

•  field  research  development  and  report  writing;  and, 

•  ethical  considerations. 

The  course  was  successfully  conducted  at  the  level  of  post-graduate  work  in  the  behavioural 
sciences.  Course  members  were  deployed  ss  «  research  tearn  to  investigate  practical  methods 
of  observing  unit  cohesion  and  to  produce  a  behavioural  science  needs  analysis  for  brigade 
units.  The  course  members  were  required  to  produce  a  final  report  of  the  exercise  prior  to 
leaving  Europe.  This  approach  was  adopted  for  the  training  of  all  future  field  observers/ad¬ 
visors  for  the  Canadian  Forces. 
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Teacher's  Perceptions  of  Severity  Ratings 
and  the  Need  to  Report  Maltreatment  in 
Militaiy  Operated  Sdiools 

JanaLee  L  Sponberg,  DA£d 

Chitci  ma^ealment.  comprised  of  cHld  abuse  and  neglect,  is  a  serious  problem. 
Mattreabnent  situations  cover  a  very  t^oad  rai^e  of  actiorts  a/to  tollures  to  ad, 
differing  greatly  in  their  nstfure  and  severity.  The  effects  of  maltre^ment  may  range 
from  m2yor  to  minor  and  may  be  physical  injury,  psychological  trauma,  sexual 
mahreatment,  deprivation  of  necessities,  or  a  camblnation.  Child  maltreatment  is  a 
oamptex  issue  invoiving  families  in  whtoh  children  are  suffering  maltreatmem  and 
involving  people  who  are  attempting  to  protect  these  children.  Professionals  such  as 
sociai  workers  and  educaiurs  need  to  be  communicating,  cooperating,  or 
collaborating  to  protec:  children.  This  poster  session  will  present  research  findings 
exantining  areas  of  simtarfty  and  differences  in  responses  to  maltreatment  severity  by 
teachers  and  social  workers. 
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DoD  Chiki  and  Spouse  Abuse  Data 
JanaLee  L  Sponberg,  DAEd 

The  of^e  of  family  policy  and  support,  a  directorate  under  the  deputy  assistant 
s&cfetsiiy  for  defense  for  fairwly  support  education  and  safety,  is  responsible  for 
coortfinalion  and  oversight  of  the  family  advocacy  program  and  related  issues.  DoD 
instrtJCtion  6400.2,  ‘Chiid  and  Spouse  Abuse  Reports"  July  10,  1987,  provides 
guidance  for  DoD  reporting  requirements 

Information  collected  by  OFP&S  between  FYB6  and  FY89  will  be  available  to  be 
presented  to  an  audience  through  the  graphic  samples  attached  and  handouts.  The 
materials  will  include  the  following: 

Annual  Report  for  .‘=Y89 
Trend  Analysis  -  FYe6-FY89 
Statistical  Comparison 
Service  FAR  Information  Handouts 

Two  studies  are  currently  under  contract  with  the  American  Association  for  Protecting 
Children  to  examine  and  refine  the  Departments  ciiiid  and  spouse  abuse  data 
collection  effort.  Materia!  could  be  made  avaiable  for  formal  presentation  of  these 
projects. 


PersonaUty-Gender  Interactions 
in  tlie  Workplace 

Laurie  C.  Walters,  PkD. 

Air  Force  Human  Resources  Laboaatety 

As  Toace  females  assume  leadership  positions  ia  traditionally  “masculine*'  career 
fidds,  it  is  iegsonant  to  consider  how  dte  female  leader  is  accq)ted  by  both  subOTdinates 
and  superoidinates.  Individual  dififetenc«  may  significantly  a^ect  how  leaders  are 
peremved-  llte  present  study  examined  how  sub(»dinates  and  superordinates,  who  vary 
cm  anduxitariamstn.  evaluate  tnale  and  female  leados. 

Suhordioation  to  a  female  leader  presents  a ‘‘dilmuna"  for  the  male  authoritarian,  as 
various  chaiftcaeristics  die  authoritarian  personality  imply  rejection  of  the  female,  while 

others  imply  acceptance.  Anthoritariaos,  who  are  somewfam  rigid  and  stereotj^ncal  in  their 
tidnidiig,  may  rej^  female  leaders  who  arc  perceived  as  viola^g  conventional  norms.  On 
the  od^hand,  audioritarians  also  tend  to  be  submissive  and  revoent  towards  audiority 
figures.  As  aiesilt,  diey  tnay  actually  evaluate  die  female  leader  ^voraldy.  Howevtx, 
When  no  longer  in  a  subozdittaie  posidon,  authoritaiians  may  be  mme  negative  in  their 
xadrtgs  of  female  leaders. 

Subje<^  were  233  male  college  students  who.  after  completing  a  measure  of 
authoritarianism:  assumed  the  rdc  of  subendinate  or  superordinate  as  they  watched  a  video 
of  a  m^  at  female  leader  conducting  a  training  group.  Subjects  then  ev^ated  du  leader 
on  such  attributes  as  ctxnpetency,  likcabOiQ',  promctabllity,  etc. 

Results  indicated  that  authoritarians,  regardless  of  their  position,  were  significantly 
naort  fiavoralde  tov/ards  male  leaders  than  ferule  leaders.  Low  aatfaoritarians,  however, 
tend^  to  he  more  favorable  towards  fonale  ieados  than  male  leadcis  when  a  inefcrence 
was  indicated.  Ute  interaction  of  gender  and  personality  suggests  possible  izi^jacts  on 
tnixed-gendo’  aew  coOT^naritni. 


.1.'  ■-  ^  •. 


ASVi^  and  I>emo^aC^ic  Profiles  of  Enlisted  Navy  Males  in 
a  Biodynamics  Research  Program: 

A  Cea&parison  of  Program  Completers  and  Koncoapleters 


LT  Schuyler  c.  Wehb,  MSC,  usnr 
Naval  Biodynamics  laboratory 
New  Orleans,  lA 


Abstract 

The  Naval  Biodynamics  Laboratory  tises  junior  enlisted  Navy 
men  as  Human  Research  Volxinteers  (HSVs)  in  its  Aircrew  Injury 
Prevention  and  Human  Factors  research  program.  As  the  need  for 
KRVs  increases  ar^  qualifying  examination  costs  rise,  optimal  HRV 
selection  is  critical.  As  a  result,  researchers  have  paid 
increasing  attention  to  differences  between  ERVs  successfully 
complete  their  research  assignment  and  HRVs  who  do  not.  The 
Armed  Bcurvices  Vocational  J^titude  Battery  (ASVAB)  is  required  of 
all  incoming  enlisted  personnel.  It  consists  of  subtests 
designed  to  measure  aptitudes  predictive  of  success  in  military 
occupations,  ^e  purpose  of  this  study  is  to  evaluate  ASVAB 
subtest  scores  and  demographic  profiles  zis  predictors  of  HRV 
success  in  our  research  program. 


Method 

ASVAB  subtest  scores  and  demographic  profileti  of  two  HRV 
groups  were  compared.  The  successful  completion  of  their 
research  eissignmcmt  was  the  x&ajor  criterion  for  evaluation. 


Results 

One  group  (N"1S)  completed  the  research  assignment;  the 
second  (N«12)  did  not.  Completers  scored  significantly  higher 
(p<.01)  on  the  Word  Knowledge  s\2btest  than  noncompleters. 
Correlations  between  Word  Knowledge  and  Mechanical  Comprehension 
scores  and  program  completion  were  positive  (r».44  and  .32, 
respectively) .  Both  groups  ware  equivalent  across  demographic 
measures.  However,  completers  had  a  higher  educational  level  and 
enrolled  part  time  in  college  during  their  tour. 


Conclusion 


The  Word  Knowledge  score  is  the  best  predictor  of  HRV 
research  program  ccmplotion.  Concomitant  with  other  evaluative 
measures  (l.e.,  personality,  motivation,  etc),  it  can  be  a  useful 
supplementary  predictor  of  HRV  success  in  biodynamics  research 
participation.  Future  studies  will  investigate  other  cost 
efficient  measures  to  predict  HRV  assignment  outcome. 
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Abstract 

This  poster  auansarizes  data  exaainlng  the  political  attitudes  of  persons 
«ho  vere  draft  age  during  the  Vietnam  conflict  (cohort  I)  and  older  persons 
,>  who  vere  not  draft  age  during  the  conflict  (cohort  II).  The  data  for  this 
'  ^tudy  were  derived  from  the  General  Social  Surveys ,  conducted  annually 

(except  for  1979  and  19SI)  since  1972  by  the  Hatlonal  Opinion  Besearch  Center. 
Cohort  X  vaa  dafined  aa  those  persons  who  were  ages  18~25  in  1973>  and 
cohort  II  was  defined  as  those  persona  ages  36>43  in  1973.  Responses  of 
a^es  and  females  Mrs  coapaiad  for  surveys  administered  from  1973  through 
lS8d.  Responiies  to  four  queacione  were  examined.  These  questions  focused  on 
ailitary  spend log »  foreign  aid  spending*  the  likelihood  that  the  U.S.  will  be 
^volved  in  another  major  war  within  the  next  10  years*  and  %dxether  the  U.S. 
should  taka  an  active  role  in  world  affairs.  The  results  indicated  that, 
over  the  years  studied,  cohort  X  believed  ve  are  spending  too  much  on  defense. 
SittUar  results  were  obtained  with  respect  to  spending  on  foreign  aid,  except 
the  differences  between  the  two  groups  diminished  through  the  19808. 

Cohort  I  also  consisteutly  expressed  a  stronger  belief  that  the  U.S.  will  be 
involved  in  another  war  soon.  With  respect  to  its  role  in  international 
affairs,  the  results  are  more  complex,  with  there  being  an  interaction 
between  cohort  axid  year  of  aurvey.  For  all  questions,  responses  of  males 
and  females  were  similar.  Implications  of  the  results  will  be  discussed. 
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